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EXECUTIVE  SUMMARY 


This  report  proposes  and  justifies  the  establishment  of  a  military  Crew 
Systems  Ergonomics  Information  Analysis  Center  (CSERIAC).  Ergonomics  Is  an 
Integrative  discipline  devoted  to  understanding  and  quantifying  human 
physiological  and  behavioral  Interaction  with  equipment  and  systems. 
Employment  of  ergonomic  Information  Is  both  essential  and  officially 
required  during  the  design  and  development  of  military  systems. 


To  determine  the  need  for  a  CSERIAC,  3705  potential  users  within  DoD  and 
Industry  were  surveyed  by  a  mall  questionnaire.  Four  existing  IACs  and 
several  centers  of  CSE  research  and  development  were  visited  to  gain 
supplementary  Information. 


Eighty-seven  percent  (87%)  of  the  829  respondents  agreed  that  a  central 
source  for  CSE  Information  services  Is  needed  and  67%  ayreed  that  a  Depart¬ 
ment  of  Defense  (DoD)  CSERIAC  was  the  appropriate  mechanism  to  meat  this 
need.  Seventy-nine  percent  (79%)  of  the  respondents  work  in  research  and 
development,  management  or  design.  Ninety-seven  percent  (97%)  use  CSE 
Information.  Seventy-eight  percent  (78%)  are  willing  to  pay  fees  for 
CSERIAC  services.  Over  4000  requests  per  year  for  CSERIAC  services  would 
be  made  by  the  survey  respondents  alone. 


Vj> 

Current  CSE  information  sources  are  Inadequate  to  the  need.  Major  problems 
Include  difficulty  in  maintaining  awareness  of  available  CSE  information, 
nonspecificity  of  information,  the  needed  information  does  not  exist,  poor 
quality,  and  delays  in  obtaining  needed  information. 


A  full-service  CSERIAC  hosted  by  the  Harry  6.  Armstrong  Aeromedical 
Research  Laboratory  is  the  proposed  solution  to  the  CSE  information  prob¬ 
lem.  CSERIAC  will  provide  CSE  Information  services  including  topical 
reviews,  special  analysis  reports,  data,  models,  CSE  design  support  soft¬ 
ware,  and  methodological  assistance  to  the  DoD  and  DoD  contractors. 
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Section  1 
INTRODUCTION 


This  report  presents  a  plan  and  justification  for  the  need  to  establish  a 
Department  of  Defense  (DoD)  Information  Analysis  Center  (IAC)  focused  on 
crew  systems  ergonomics.  Ergonomics  Is  an  Integrative  discipline  devoted 
to  understanding  and  quantifying  human  physiological  and  behavioral  charac¬ 
teristics  Important  to  the  design  and  operation  of  equipment  and  systems. 
The  effectiveness  ot  military  systems  ultimately  depends  on  the  ability  of 
its  human  crew  members  to  correctly  and  efficiently  emoloy  equipment  capa- 
bllltles  to  accomplish  mission  goals.  Moreover,  maintaining  the  physical 
well  being  and  Integrity  of  crew  members  Is  essential  to  the  survival  and 
sustained  operation  of  military  crew  systems.  The  tempo  and  lethality  of 
modern  warfare,  as  well  as  the  Increasing  complexity  of  weapons  systems, 
have  placed  such  extreme  demands  on  the  crew  tiiat  human  performance  and 
endurance  are  primary  factors  limiting  the  enhancement  of  military  system 
effectiveness. 

Employment  of  ergonomic  information  Is  both  essential  and  officially 
required  during  the  design  and  development  of  military  systems.  Ergonomic 
Information  consists  of  a  synthesis  of  knowledge  and  data  drawn  from  a 
variety  of  traditional  scientific  and  engineering  disciplines  to  meet  the 
needs  of  a  particular  application.  Although  ergonomic  Information  Is 
latent.  In  the  broad  base  of  scientific  and  engineering  knowledge  devoted  to 
human  physiological  and  behavioral  characteristics.  It  Is  not  readily 
accessible  or  compiled  In  a  form  most  useful  to  particular  engineering 
design  and  development  efforts.  Consequently,  there  is  an  apparent  criti¬ 
cal  need  for  a  central  and  authoritative  source  that  can  provide  timely, 
complete  and  Integrated  crew  systems  ergonomic  (CSE)  information  to  DoD 
managers,  scientists  and  engineers  and  DoD  contractors  Involved  In  research 
and  development  of  military  equipment  and  systems. 

To  determine  the  validity  of  the  need  for  a  DoD  center  devoted  to  the 
analysis  and  dissemination  of  military  CSE  information,  a  survey  question¬ 
naire  was  mailed  to  a  large  sample  of  the  community  of  potential  users 
within  the  DoD  and  industry.  Also,  key  DoD  activities  involved  In  crew 
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Systi&ii  Search  and  development  Mere  visited  to  obtain  more  detailed  infor- 
ttdtibn  bn  current  use  and  sources  of  CSE  Information,  as  well  as  the  per¬ 
fected  Vilue  of  A  DoO  IAC  devoted  to  providing  CSE  Information  analysis 
kbrvlces. 


1.1  Background 

Knowledge  of  what  the  human  crew  member  Is  capable  of  doing,  the  stressors 
that  he  or  she  can  withstand,  and  constructing  equipment  that  most  effec¬ 
tively  melds  with  human  abilities  and  limitations  is  an  Important  aspect  of 
military  systems  development  from  the  management  planning  stage  to  final, 
operational  test  and  evaluation. 

i 

The  Air  Force  Aerospace  Medical  Research  Laboratory,  now  named  the  Harry  G. 
Armstrong  Aerospace  Medical  Research  Laboratory  (AAMRL) ,  recognized  the 
Increasing  criticality  of  CSE  Information  to  the  aerospace  programs  of  the 
Air  Force  and  other  DoD  components.  As  a  primary  user,  as  well  as  a  gen¬ 
erator,  of  CSE  information  AAMRL  has  frequently  encountered  the  difficul¬ 
ties  and  delays  In  formulating  CSE  Information  to  meet  the  needs  of  its  own 
divisions  and  the  Air  Force  activities  It  supports. 

Viewing  the  establishment  of  a  CSE  IAC  as  a  potential  means  for  solving  a 
variety  of  CSE  information  problems,  AAMRL  decided  to  conduct  a  survey  of 
the  community  of  CSE  information  users.  The  purpose  of  the  survey  was  to 
determine  CSE  information  problems  encountered,  information  services 
needed,  currently  available  sources,  CSE  topics  of  primary  concern,  whether 
a  DoD  IAC  would  be  considered  an  appropriate  mechanism  for  providing  CSE 
Information  and  to  what  degree  the  IAC  would  be  used  and  supported.  Addi¬ 
tionally,  DoD  organizations  known  to  be  heavy  users  of  CSE  information  were 
visited  to  obtain  more  detailed  insights  on  the  subjects  addressed  in  the 
questionnaire  survey.  Several  IACs  also  were  visited  to  learn  of  their 
current  practices. 
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1.2 


STATEMENT  OF  THE  PROBLEH 


In  general,  the  problem  is  the  lack  of  a  means  to  Identify  and  select  from 
the  large  volume  of  potential  sources  the  data  necessary  to  formulate  CSE 
information  and  to  present  it  in  a  form  that  can  be  understood  by  the  user 
and  applied  to  a  particular  need.  The  sources  for  CSE  information  are  pri¬ 
marily  documents,  but  also  Include  human  performance  and  anthropometric 
models  and  data  bases,  as  well  as  analysis  methods  that  are  important  in 
the  design  process. 

The  CSE  interests  and  needs  of  managers,  scientists,  engineers  and 
designers  differ  in  scope  and  emphasis.  Moreover,  most  users  of  CSE  infor¬ 
mation,  other  than  research  scientists,  have  been  educated  In  engineering 
rather  than  the  biomedical  or  behavioral  sciences.  Consequently,  these 
users  are  unfamiliar  with  the  primary  source  literature  for  CSE  information 
and  do  not  have  the  special  training  necessary  to  knowledgeably  assess  and 
interpret  it  in  terms  of  their  application  needs. 

The  sheer  volume  of  biomedical,  behavioral  and  engineering  information  and 
data  that  exists  and  is  being  generated  creates  an  immediate  problem  for 
those  in  need  of  CSE  information.  Moreover,  this  Is  a  period  of  growth  of 
new  ergonomic  modeling  and  analysis  methods  for  applying  CSE  information. 

It  is  virtually  impossible  for  an  individual  to  keep  abreast  of  develop¬ 
ments  except  in  a  few  specialty  areas.  Yet,  by  its  very  nature,  the  useful 
application  of  CSE  Information  requires  integration  of  knowledge  and  data 
across  a  broad  range  of  human  characteristics. 

The  Defense  Technical  Information  Center  (DTIC)  provides  copies  of  orginal 
source  documents  and  specialized  bibliographies  based  on  key-word  searches 
of  CSE  reports  generated  by  DoD  laboratories  and  DoD  contractors.  Although 
these  are  valuable  services,  the  users  of  DTIC  must  decide  what  documents 
and  bibliographic  search  strategies  will  yield  the  information  that  they 
need.  A  common  problem  is  the  uncertainty  that  the  documents  relevant  to  a 
particular  need  have  been  found.  Moreover,  users  are  burdened  with  the 
analytical  and  interpretive  tasks  of  extracting,  evaluating  and  integrating 
the  information  contained  in  the  source  documents.  These  tasks  are 
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especially  difficult  for  documents  written  by  scientists  or  engineers  whose 
specialties  are  outside  the  user's  domain  of  expertise. 

Also,  obtaining  copies  of,  or  access  to,  computer  data  bases,  and  models 
such  as  the  Computerized  Biomechanical  Man-Model  (COMBIMAN,  see  section 
3.3)  and  the  Hunan  Operator  Simulator  (HOS),  as  well  as  closely  allied  pro¬ 
gramming  software  such  as  Systems  Analysis  of  Integrated  Networks  of  Tasks 
(SAINT),  is  difficult  at  best.  The  number  of  human-related  data  bases  and 
models  potentially  available,  but  practically  inaccessible,  number  over  SO 
(Topmlller,  1981).  Yet  these  are  Important  tools  that  should  be  widely 
used  to  apply  CSE  information  in  crew  system  design  work. 

■ 

The  need  for  a  widely  available  mechanism  to  find,  analyze,  and  disseminate 

CSE  Information  to  users  within  the  DoD  and  its  contractors  was  substan-. 

tiated  by  the  responses  to  the  questionnaire  survey  (Appendix  A).  The 

following  were  identified  as  being  the  most  frequent  or  important  serious 

problems  in  fulfilling  the  needs  for  CSE  information.  ' 

1.  Difficulty  in  maintaining  awareness  of  technical  or  analytical 
information  that  Is  available  (59%  of  respondents). 

2.  Information  not  specific  to  particular  needs  (39%  of 
respondents) . 

3.  The  needed  information  does  not  exist  (37%  of  respondents). 

j 

i 

4.  Poor  quality  of  the  information  (36%  of  respondents) .  j 

5.  Delay  time  to  obtain  needed  information  (35%  of  respondents).  j 

I 

6.  Information  not  clearly  and  succinctly  presented  (34%  of  j 

respondents).  !| 

These  results  clearly  support  the  allegation  that  there  is  a  definite  need  j 

for  a  means  to  improve  the  availability,  specific  applicability  and  quality  ] 

of  CSE  infonnation.  \ 
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1.3 


DoD  I AC  AS  THE  SOLUTION  TO  CSE  INFORMATION  PROBLEMS 


As  a  matter  of  policy,  the  DoD  recognizes  t.he  value  of  evaluation  and 
analysis  of  scientific  and  technical  information  to  the  conduct  of  research 
and  development  efforts.  Furthermore,  the  DoD  endorses  the  institutionali¬ 
zation  of  these  activities  in  the  form  of  IACs  when  sufficient  requirements 
or  benefits  are  established  (Department  of  Defense,  1984). 

Twenty -one  IACS  have  been  established  that  specialize  in  either  a 
discipline-oriented  or  mission-oriented  area.  The  function  of  an  IAC  is 
prescribed  by  its  definition  given  In  the  DoD  regulation  cited  above: 

"Centers  for  Analysis  of  Scientific  and  Technical  Information:  A  for¬ 
mal  organization  with  a  primary  mission  to  acquire,  digest,  analyze, 
evaluate,  synthesize,  store,  publish,  and  provide  advisory  and  other 
user  services  concerning  available  worldwide  scientific  and  technical 
information  and  engineering  data  in  a  clearly  defined,  specialized 
field,  or  subject  area  of  significant  DoD  Interest  or  concern.  Infor¬ 
mation  Analysis  Centers  (IACs)  are  distinguished  from  technical  infor¬ 
mation  centers  and  libraries  whose  functions  primarily  are  concerned 
with  providing  reference  or  access  to  the  documents  themselves  rather 
than  the  information  contained  In  the  documents." 

CSE  is  clearly  an  area  of  significant  concern  to  the  DoD.  The  military 
standard  MIL-H-46855B  details  the  human  factors  and  ergonomic  requirements 
that  must  be  addressed  in  the  development  of  military  systems.  Yet,  as 
noted  by  the  National  Academy  of  Sciences  Committee  on  Automation  in  Combat 
Aircraft,  "For  a  number  cf  reasons  this  guideline  has  not  been  followed 
(Committee  on  Automation  in  Combat  Aircraft,  1982,  py.  59)."  One  reason  is 
the  lack  of  CSE  information  distilled  from  the  scientific  literature  and 
presented  in  a  way  useful  to  design  engineers.  This  assertion  was  corrob¬ 
orated  by  the  former  director  of  the  U.S.  Army  Aeromechanics  Laboratory  at 
a  recent  NATO  symposium: 
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"The  psycho-physiological  literature  is  replete  with  data  on  specific 
laboratory  experiments,  but  the  results  have  seldom  been  focused  on 
the  design  of  a  man-machine  system  and  have  never  been  conveyed  in 
terms  meaningful  to  the  engineering  user  community.  The  terminology 
Is  often  unfamiliar  to  the  engineer,  and  the  implications  tor  design 
are  not  readily  accessible.  Consequently,  the  designer  often  faiis  to 
recognize  the  relevance  of  the  Information  to  his  problem.  Design 
engineers  need  to  have  the  Information  in  a  form  which  is  meaningful 
to  system  design  problems.  (Statler,  1984)" 

The  nature  of  CSE  Information  is  such  that  its  analysis,  evaluation  and 
synthesis  Is  a  prerequisite  to  its  useful  application.  The  establishment 
of  a  Crew  Systems  Ergonomics  Information  Analysis  Center  (CSERIAC)  is  pro¬ 
posed  as  the  most  appropriate  means  to  alleviate  the  problems  of  providing 
CSE  Information  to  DoD  users  and  DoD  contractors  in  a  form  that  meets  their 
needs. 


1.4  STUDY  APPROACH 

The  impetus  for  the  present  study  was  the  recognition  by  specialists  in  the 
fields  of  human  factors  engineering  and  ergonomics  of  the  difficulty  of 
providing  CSE  information  services  to  the  large  community  of  users  among 
managers,  scientists  and  design  engineers  within  the  DoD  and  DoD 
contractors. 

A  primary  purpose  of  the  study  was  to  gather  evidence  on  the  prevalence  and 
importance  of  this  need,  what  CSE  topics  were  most  commonly  of  concern, 
what  services  in  what  form  would  best  fulfill  the  needs  for  CSE  information 
and  whether  a  DoD  IAC  would  be  perceived  to  be  the  most  appropriate  means 
to  meet  these  needs.  Another  important  purpose  was  to  discover  whether 
existing  sources  provide  the  needed  CSE  information  services. 

Initially,  known  users  of  CSE  information  at  AAMRL  and  other  Air  Force 
laboratories  at  Wright-Patterson  Air  Force  Base  were  informally  questioned 
about  problems  they  encountered  in  obtaining  CSE  information,  the  kind  of 
information  they  sought  and  what  sources  they  used  or  know  of.  The 
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informal  questioning  was  extended  to  CSE  information  users  at  other  DoD 
installations  and  professional  colleagues  In  Industry. 

A  second  step  was  to  review  mission  statements  of  organizations  known  to  be 
involved  in  scientific  and  technical  information  dissemination  that 
includes,  at  least  in  part,  CSE  Information.  These  included  the  Manpower 
and  Training  Information  System  (MATRIS),  Defense  Technical  Information 
Center  (OTIC),  the  National  Technical  Information  Service  (NTIS),  the 
Defense  Training  Data  and  Analysis  Center  (TDAC),  as  well  as  existing  DoD 
IACS. 

The  preliminary  investigations  confirmed  that  none  of  the  known  sources 
provided  the  primary  types  of  CSE  Information  users  required.  Based  on 
these  inquiries  AAMRL  formulated  a  conception  of  the  scope  of  the  topics 
and  services  envisioned  to  be  within  the  domain  of  the  proposed  IAC. 

AAMRL  then  decided  to  formally  gather  the  necessary  data  and  information 
needed  to  prepare  the  proposal  and  justification  for  establishing  the 
C SERI AC. 

The  formal  effort  consisted  of  a  questionnaire  survey  of  a  substantial  pro¬ 
portion  of  the  known  users  and  generators  of  CSE  information,  and  inter¬ 
views  with  key  personnel  at  DoD  Installations  that  have  significant  crew 
systems  research  and  development  activities.  The  data  from  the  question¬ 
naire  survey  and  interviews  were  compiled  and  analyzed  and  form  the  primary 
evidentiary  base  of  this  report. 

The  questionnaire  was  mailed  to  3705  individuals  within  the  DoD  and  indus¬ 
try  likely  to  have  an  interest  In  aerospace  CSE.  Eight  hundred  and  twenty- 
nine  (829)  of  the  1000  returned  were  useable  for  analysis.  The  background 
data  on  the  respondents  confirmed  their  interest  and  use  of  CSE  informa¬ 
tion.  Seventy-nine  percent  (79%)  of  the  respondents  work  in  research  and 
development,  management  or  design.  Ninety-seven  percent  (97%)  use  CSE 
i nformation. 
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The  analysis  of  the  questlonnai  e  survey  data  is  presented  in  detail  in 
Appendix  A.  However,  the  principal  outcomes  are  easily  summarized. 
Eighty-seven  percent  (87%)  of  the  829  respondents  agreed  that  a  central 
source  of  CSE  information  services  Is  needed  and  67%  agreed  that  a  Depart¬ 
ment  of  Defense  (DoD)  CSERIAC  was  the  appropriate  mechanism  to  meet  this 
need.  Seventy-eight  percent  (78%)  are  willing  to  pay  fees  for  CSERIAC 
services.  Over  4000  requests  per  year  for  CSERIAC  services  would  be  made 
by  the  survey  respondents  alone.  In  addition  to  the  questionnaire  survey, 
four  existing  IACS  were  visited  to  learn  of  their  method  of  operation  in 
greater  detail  and  to  benefit  from  their  experience  in  analyzing  and  dis¬ 
seminating  specialized  scientific  and  technical  information.  It  was  clear 
from  review  of  the  individual  missions  that  only  three  of  the  twenty-one 
existing  IACS  potentially  have  any  remote  connection  to  CSE.  These  are  the 
Tactical  Technology  Center  (TACTEC),  the  Shock  and  Vibration  Information 
Center  (SVIC)  and  the  recently  established  Survivability/Vulnerability 
Information  Analysis  Center  (SURVIAC). 

1.5  PURPOSE  OF  THIS  REPORT 

The  principal  purposes  of  this  report  are  to  detail  the  justification  for 
establishing  the  CSERIAC  and  present  a  plan  for  its  implementation.  The 
evidence  for  the  need  for  the  CSERIAC,  its  scope  of  concern  and  the 
services  it  will  provide  is  drawn  primarily  from  the  results  of  the  ques¬ 
tionnaire  survey  (Appendix  A).  Amplifications  on  the  nature  of  CSE  infor¬ 
mation,  how  it  is  used  and  by  whom,  as  well  as  alternatives  to  CSERIAC  are 
also  presented. 

This  report  excludes  a  discussion  of  the  purposes  and  functions  of  IACs  in 
general  since  these  are  well  documented  both  in  the  implementing  regulation 
(Department  of  Defense,  1984)  and  in  the  recent  document,  Proposal  and 
Justification  for  the  Establishment  of  an  Aeronautical  Systems/ Target  No in-_ 
nuclear  Conte,  s  for  Analysis  of  Scientific  and  Technical  Informati on  Sur- 
vivabi lity/Vulnerabi lity  Information  Analysis  Center  (Bernier,  Mower,  and 
Horton,  1982).  It  should  also  be  noted  that  this  latter  document  contains 
a  comprehensive  review  of  the  operations  of  sixteen  IACs.  because  of  the 
recency  of  this  information  there  appeared  to  be  no  purpose  in  conducting 
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survey  Interviews  of  IACs  beyond  the  four  visited.  The  information  on  IACs 
contained  in  the  cited  document  was  a  valuable  aid  In  formulating  the 
Implementation  plan  for  the  proposed  CSERIAC. 
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Section  2 

DETERMINATION  OF  NEED 


Without  adequate  CSE  Information,  system  designers  and  developers  are 
forced  to  rely  on  approximations  or  guesswork  to  predict  the  range  of  human 
responses  to  various  design  options.  An  expensive  alternative  is  to  per¬ 
form  part-task  research  to  acquire  the  needed  data.  Good  CSE  data,  there¬ 
fore,  supports  the  development  of  effective  systems  at  reduced  cost  and 
equates  to  better  system  design  for  enhanced  mission  effectiveness  and 
survivability. 

2.1  WHAT  IS  CSE  INFORMATION? 

i 

j 

In  general,  CSE  information  is  scientific  and  technical  knowledge  and  data 
about  human  characteristics,  abilities,  limitations,  physiological  needs, 
performance,  body  dimensions,  biomechanical  dynamics,  strength,  and  toler¬ 
ances.  It  is  also  engineering  and  design  data  about  equipment  intended  to 
be  used,  operated,  or  controlled  by  members  of  military  crews.  The  human 
oriented  data  and  knowledge  come  from  research  and  affect  future  equipment 
and  systems  design  and  development;  the  engineering  and  design  data  are  the 
lessons  learned  from  existing  equipment,  both  good  and  bad,  that  have 
proven  what  enhances  and  supports  or  degrades  and  debilitates  crew  perform¬ 
ance  and  well  being. 

1 

The  domain  of  CSE  information  is  the  Interaction  of  humans  with  equipment 
and  how  each  affects  the  other.  It  extends  *  l  the  human  direction  to 
include  biomedical,  physiological,  behavioral,  and  cognitive  characteris¬ 
tics  and  functions.  It  extends  in  the  equipment  direction  to  include  the 
displays,  controls,  operational,  and  functional  characteristics  of  mission 
subsystems  and  those  intended  to  support  the  health,  survival,  and  escape 
of  crew  members. 

CSE  information  is  highly  specialized  because  it  pertains  to  human  charac-  | 

teristics  as  found  in  complex,  real-world  military  situations  and  activi-  ! 

ties;  these  operationally  relevant  characteri sties  are  usually  different 

i 

i 

i 
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from  those  determined  In  Isolation  In  the  biomedical  or  behavioral 
laboratory. 

The  terms  "ergonomics"  and  "human  factors"  are  nearly  synonymous.  Ergo¬ 
nomics  Is  the  term  used  in  Europe  to  refer  to  the  study  of  humans  at  work, 
with  emphasis  on  the  physical  design  of  work  areas  and  worker  physiology. 
Human  factors  is  the  equivalent  term  used  in  the  United  States,  although 
the  emphasis  is  on  the  infrrmat1on  processing  requirements  of  the  human 
during  job  performance.  The  objective,  in  either  case,  is  to  enhance  the 
effectiveness  of  manned  systems. 

2.2  WHAT  IS  AVAILABLE  AND  WHERE? 

The  major  sources  of  CSE  information  are  professional  journals,  technical 
reports,  unpublished  data,  handbooks  and  standards,  computer  models,  expert 
consultation,  methodological  guidelines,  and  search  and  analysis  services. 

2.2.1  Journals 


Currently,  CSE  information  is  available  In  several  journals,  such  as  Human 
Factors,  Ergonomics,  and  Aviation,  Space  and  Environmental  Medicine.  A 
large  number  of  academic  journals  from  experimental  psychology,  physiology, 
engineering,  and  computer  science  report  basic  Information  that  contributes 
to  the  knowledge  base  o.  CSE.  Journals  are  not  available  from  the  NTIS. 
They  are  normally  procured  through  subscription  or  libraries. 

2.2.2  Technical  Reports 

The  largest  single  source  of  C Zl  information  is  found  in  government  techni¬ 
cal  reports.  Abstracts,  bibliographies  and  copies  of  original  reports  are 
available  through  OTIC  and  NTIS.  The  former  provides  both  classified  and 
unclassified  source  documents  produced  for  the  DoD.  The  latter  provides 
only  unclassified  documents  but  includes  reports  produced  for  all  Federal 
Government  Departments. 
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2.2.3 


Test  and  Evaluation  (TIE)  Data 


Valuable  C3E  Information  Is  generated  during  system  development,  test  and 
evaluation.  However,  T4E  reports  and  data,  that  represent  valuable 
“lessons  learned,"  are  a  resource  only  within  the  organizations  that  either 
requested  or  performed  the  T4E.  These  documents  are  not  collected  and 
archived  by  ar\y  single  organization.  Consequently,  these  CSE  Information 
resources  are  not  readily  available  to  CSE  specialists  or  aerospace  system 
design  engineers. 

2.2.4  Handbooks  and  Standards 

There  are  several  handbooks  that  consolidate  human  factors  and  ergonomics 
information  for  engineering  design.  These  handbooks  have  the  problems, 
however,  of  becoming  dated  and  being  presented  in  an  inflexible  format. 
Examples  of  major  handbooks  are  Van  Cott  and  Klnkade  (1972)  and  Woodson 
(1981).  Military  Standard  1472-C  (DoD,  1981),  titled  "Human  Engineering 
Design  Criteria  for  Military  Systems,  Equipment,  and  Facilities"  also  pro¬ 
vides  CSE  guidance  for  systems  design.  The  handbooks  and  standard  are  sup¬ 
plemented  by  textbooks  In  human  factors  such  as  McCormick  and  Sanders 
(1982)  and  Wlckens  (1984).  All  of  these  resources  are  useful  for  general 
guidance,  but  are  Inadequate  for  specific  CSE  design  application  needs. 

2.2.5  Models 

Much  CSE  information  is  summarized  In  mathematical  and  computer-based 
models  of  human  operators.  These  models  may  address  either  anthropometric 
and  biomechanical  characteristics  or  percept  al-coynitive-motor  character¬ 
istics  of  humans.  Models  are  a  means  for  tradeoff  evaluations  of  human- 
system  performance  for  various  design  alternatives.  CSE  models  are  useful 
tools  for  solving  design  problems  However,  most  CSE  models  are  developed 
and  used  in  one  location  and  are  not  readily  accessible  to  the  potentially 
large  community  of  users. 
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2.2.6  Expert  Consultation 


One  hh'  nod  of  direct  access  to  CSE  information  is  to  consult  with  a 
researcher  or  applied  scientist  who  has  been  working  specifically  on  a 
problem  area.  Four  canmon  sources  for  identifying  such  people  are  through 
journal  articles  and  publications,  membership  lists  of  professional  socie¬ 
ties,  the  DoD  Directory  of  Researchers  for  Human  Research  and  Development 
Projects,  and  the  Directory  of  U.S.  Army  Human  Factors  Engineering  Special¬ 
ists.  However,  the  role  of  a  consultant  is  generally  limited  to  answering 
relatively  simple  questions.  For  more  complicated  Issues,  involving  sub¬ 
stantial  time  and  effort,  a  contractual  mechanism  must  be  established  to 
pay  for  the  consultant’s  work.  The  length  of  time  required  to  let  a  con¬ 
tract,  particularly  by  the  Goverrment,  will  generally  preclude  use  of  a 
consultant  unless  the  need  was  anticipated  well  In  advance. 

2.2.7  Methodological  Guidelines 

A  wide  range  of  empirical  and  analytical  methodologies  is  used  to  solve  CSE 
problems.  They  include  techniques  for  test  and  evaluation  and  analysis  of 
human-system  Interaction,  task  performance,  time-line  of  activities,  and 
imposed  workload  Other  CSE  methods  Involve  computer  modeling,  user  sur¬ 
veys,  rating  scales,  checklists,  and  formal  procedures  to  obtain  expert 
opinions.  However,  information  on  these  important  CSE  methods  is  not  docu¬ 
mented  or  collected  in  any  systematic  fashion. 

The  National  Academy  of  Sciences  Committee  on  Human  Factors  identified  the 
lack  of  information  on  applied  methodologies  as  a  major  problem.  The  com¬ 
mittee  concluded  "There  is  a  serious  disparity  between  the  importance  of 
applied  methodologies  for  human  factors  work,  particularly  systems  and 
equipment  design,  and  the  efforts  being  made  to  document  and  codify  them  in 
a  standard  manner.  (Committee  on  Human  Factors,  1983,  pg.  156)" 

2.3  WHO  NEEDS  CSE  INFORMATION  AND  WHY? 

The  broad  spectrum  of  primary  users  of  CSE  information  are  the  managers, 
scientists  and  engineers  within  the  DoD,  other  Government  organizations. 
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and  OoD  contractor  Industries  that  are  Involved  In  research  and  development 
of  manned  systems  for  aviation  and  space  and  require  timely,  reliable  and 
specialized  CSI  Information.  Examples  of  OoD  users  are: 

•  Department  of  the  Air  Force 

Deputy  Chief  of  Staff,  Research,  Development  and  Acquisition 
Deputy  Chief  of  Staff,  Logistics  and  Engineering 
flight  Test  Center 
Tactical  Warfare  Center 
Operational  Test  A  Evaluation  Center 
Inspection  A  Safety  Center 
Space  A  Missile  Systems  Organization 
Aerospace  Medical  Division 
—  School  of  Aerospace  Medicine 

—  Armstrong  Aerospace  Medical  Research  Laboratory 

Human  Resources  Laboratory 
Rome  Air  Development  Center 
Electronic  Systems  Division 
Aeronautical  Systems  Division 
—  Wright  Aeronautical  Laboratory 
Office  of  Scientific  Research 

•  Department  of  the  Navy 

Naval  Air  Systems  Command 

Naval  Air  Development  Center 

Naval  Air  Test  Center 

Naval  Weapons  Center 

Naval  Ocean  Systems  Center 

Naval  Training  Equipment  Center 

Naval  Aerospace  Medical  Research  Laboratory 

Naval  BloDynamlcs  Laboratory 

Navy  Personnel  RAD  Center 

Pacific  Missile  Test  Center 

Office  of  Naval  Research 
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•  Department  of  the  Army 


Deputy  Chief  of  Staff  for  Research,  Development,  and  Acquisition 

Aviation  Research  and  Development  Command 

Aviation  Development  Test  Activity 

Aeromedlcal  Research  Laboratory 

Aviation  Safety  Center 

Human  Engineering  Laboratory 

Operational  Test  A  Evaluation  Agency 

Training  and  Doctrine  Command 

Natick  Research  A  Development  Center 

Army  Research  Institute 

Non-Doll  Government  users  of  CSE  information  Include: 

•  National  Aeronautics  and  Space  Administration  (NASA) 

NASA  Headquarters 
Ames  Research  Center 
Johnson  Space  Certer 
Marshall  Space  Flight  Center 
Langley  Research  Center 
Jet  Propulsion  Laboratory 

•  Department  of  Transportation 

Transportation  Systems  Center 
II, S.  Coast  Guard 

•  Federal  Aviation  Administration 

FAA  Headquarters 
FAA  Technical  Center 

•  National  Transportation  Safety  Board  (NTSH) 
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industry  users  Mould  Include  all  major  airframe  firms  and  smaller  firms 
performing  OoD  research  and  development  contracts  In  support  of  the  Dol)» 
Major  airframe  companies  that  Mould  use  CSERIAC  Include: 

0  Bell  Helicopters 

e  Boeing 

e  General  Dynamics 

e  Grumman 

e  Hughes  A1 rcraft  Company 

e  Lockheed 

e  McDonnel 1 -Doug 1  as 

e  Northrop 

e  Sikorsky 


Section  3 

RECOMMENDED  SOLUTION 


Establishment  of  a  full-service  CSERIAC  is  the  recommended  solution  to  the 
problem  of  providing  CSE  Information  services  to  the  broad  community  of 
users  within  the  DoD  and  Its  contractors. 

3.1  WHAT  ARE  ALTERNATIVE  SOLUTIONS 

Alternatives  to  CSERIAC  for  sources  of  CSE  Information  fall  Into  three 
categories;  current  practices,  existing  IACs,  and  other  national  Informa¬ 
tion  sources.  These  alternatives  to  a  DoD  CSERIAC  must  be  considered  in 
light  of  the  problem  of  providing  analyzed  and  evaluated  Information  spe¬ 
cific  to  a  user's  need. 

Current  practice  is  for  users  to  obtain  the  Information  themselves  from 
primary  sources  or  recruit  the  services  of  in-house  human  factors  and 
ergonomic  specialists.  The  questionnaire  survey  (Appendix  A)  revealed  that 
the  common,  current  practice  is  to  obtain  CSE  Information  from  primary 
source  document,,  i.e.,  journals,  technical  reports  obtained  from  the  orig¬ 
inator,  OTIC  and  NTIS,  handbooks  and  textbooks,  or  the  user  goes  to  a  staff 
specialist  or  colleague.  Data  bases,  local  libraries,  and  outside  consul¬ 
tants  are  rarely  used  as  primary  sources  of  CSE  Information. 

The  current  resources  have  several  serious  deficiencies  as  providers  of  CSE 
information.  Journals  and  technical  reports  must  be  reviewed  and  the 
applicable  information  extracted.  This  information  In  turn  must  be  evalu¬ 
ated  and  analyzed  in  terms  of  Its  appllccbi li ty  to  the  particular  prob¬ 
lem.  This  task  will  devolve  to  the  user  and  the  ultimate  quality,  of  the 
informatics1  will  depend  on  the  Individual's  knowledge  of  the  fields  from 
which  the  source  material  was  drawn.  Since  a  large  proportion  of  end  users 
are  engineers  and  most  CSE  Information  is  drawn  from  the  life  sciences  and 
behavioral  sciences,  many  users  are  poorly  prepared  to  do  the  necessary 
evaluation  and  analysis. 


If  a  human  factors  and  ergonomics  specialist  Is  asked  to  compile  CSE  infor¬ 
mation,  he  or  she  must  perform  the  same  tasks  as  an  IAC  staff  member  but 
without  the  ability  to  tap  as  wide  a  range  of  source  material  as  available 
to  an  IAC  staff  member.  DTIC  reports  are  limited  to  those  produced  at  DoL) 
expense  and  local  libraries  are  not  comprehensive  In  their  document  cover¬ 
age  of  the  relevant  literature.  Useful  sources  of  CSE  information  such  as 
models,  computer-based  analysis  methods  and  design  templates  are  generally 
unavailable  from  document  sources.  Furthermore,  the  individual  tasked  with 
meeting  a  CSE  Information  requirement  may  not  have  a  good  current  awareness 
of  the  particular  problem  area.  In  essence,  the  shortcomings  of  these 
alternatives  are  the  common,  prevalent  problems  currently  encountered  and 
part  of  the  basis  for  justifying  the  establishment  of  the  CSERIAC. 

None  of  the  existing  IACs  provide  CSE  Information  services  as  part  of  their 
mission.  This  was  confirmed  by  the  visits  to  the  three  IACs  (SURVIAC, 

SVIC,  TACTEC)  that  might  have  included  some  part  of  CSE  in  their  data 
bases. 

There  are  two  existing  national  information  sources  that  have  some  rela¬ 
tionship  to  CSE  information;  the  Defense  Training  Data  and  Analysis  Center 
(TDAC) ,  colocated  with  the  Naval  Training  Equipment  Center  (NTEC)  and  the 
Army  Program  Manager,  Training  Devices  (PM  TRADE)  in  Orlando,  Florida,  and 
the  Manpower  and  Training  Research  Information  System  (MATRIS)  located  at 
the  Navy  Personnel  Research  and  Development  Center  (NPRDC),  San  Diego, 
California.  However,  neither  is  a  source  of  CSE  information,  per  se.  TDAC 
focuses  on  training  related  behavioral  and  engineering  information.  In 
recognition  of  TDAC's  mission,  training  information  has  been  explicitly 
excluded  from  the  proposed  scope  of  topics  for  CSERIAC.  MATRIS  provides 
information  about  ongoing  or  completed  research  supported  by  the  DoD  that 
falls  within  the  Congressional  personnel  reporting  category  of  manpower  and 
training.  Substantive  infonnation  is  limited  to  unevaluated  abstracts  of 
work  in  progress  or  completed.  Moreover,  the  Congressional  personnel 
reporting  category  of  human  factors  is  more  centrally  related  to  CSE  infor¬ 
mation  than  manpower  and  training. 
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In  sunmary  there  are  no  existing  cltematlves  to  the  proposed  CSERIAC  that 
provide  the  specialized  CSE  Information  services,  i.e.,  specialized  analy¬ 
sis,  data  bases,  models,  computer-based  methodologies,  and  design  templates 
necessary  to  support  the  needs  of  the  DoD  and  its  contractors. 

3.2  CSERIAC  MISSION  STATEMENT 

AAMRL  developed  a  preliminary  conception  of  the  scope  of  subject  matter  and 
functions  for  the  CSERIAC  but  did  not  produce  a  formal  mission  statement. 

It  was  believed  to  be  more  prudent  to  base  the  mission  statement  and  func¬ 
tions  on  the  interests  and  needs  of  the  user  community  as  expressed  In  the 
results  of  the  questionnaire  survey  (Appendix  A).  The  following  mission 
statement  was  formulated  based  on  the  analysis  of  the  questionnaire 
returns. 

3.2.1  Proposed  Mission  Statement  for  a  Crew  Systems  Ergonomics 
Information  Analysis  Center  (CSERIAC) 

CSERIAC' s  mission  is  to  perform  the  functions  of  a  full  service  Department 
of  Defense  (DoD)  Information  Analysis  Center  (IAC)  as  described  in  "Centers 
for  Analysis  of  Scientific  and  Technical  Information  Regulation,"  (Depart¬ 
ment  of  Defense,  1984).  It  will  provide  scientific  and  technical  informa¬ 
tion  services  to  DoD  organizations  and  their  contractors.  CSERIAC's  score 
of  subject  matter  will  be  crew  systems  ergonomics  for  military  systems. 

CSERIAC's  data  bases  will  consist  of  biomedical,  physiological,  behavioral, 
and  engineering  information  specifically  derived  from,  or  applicable  to, 
crew  systems  research,  development,  design,  test  and  evaluation.  CSERIAC 
will  also  maintain  current,  computer- accessible,  bibliographic  data  bases 
of  its  document  holdings  and  provide  access  to  other  relevant  data  bases. 

It  will  review  and  summarize  new  information  and  disseminate  it  through 
bulletins,  bibliographies,  and  reports. 

CSERIAC  also  will  serve  as  a  repository  and  source  of  other  forms  of  crew 
system  ergonomics  information  and  data,  such  as  models,  methodologies,  and 
design  support  software.  CSERIAC  will  maintain  limited  crew  system  design 


support  hardware  necessary  to  provide  specialized  forms  of  crew  systems 
Information. 

CSERIAC  will  be  a  focal  point  within  the  DoD  for  military  crew  systems 
ergonomic  Information. 

3.3  CSERIAC  LOCATION 

AAMRL  at  Wrlght-Patterson  Air  Force  Base  (WPAFB),  Ohio,  Is  proposed  as  the 
host  organization  and  physical  location  of  the  CSERIAC.  AAMRL  Is  the 
largest  single  DoD  organization  Involved  In  aerospace  crew  systems  research 
and  development.  AAMRL  programs  and  Its  professional  staff  are  involved  i 
biomedical,  physiological,  behavioral,  ergonomic,  and  engineering  aspects 
of  crew  system  development.  Consequently,  AAMRL  has  developed  several  CSfc 
Information  and  design  products  that  could  most  effectively  be  provided  to 
the  user  community  through  CSERIAC. 

3.3.1  Anthropometry  and  Biomechanics 

Anthropometric  and  biomechanical  Information  exists  in  several  forms  at 
AAMRL.  For  researchers,  the  Biodynamics  and  Bioengineering  Division  of 
AAMRL  maintains  a  bibliography  of  over  40,000  entries  on  biodynamics.  For 
engineers  Involved  In  crew  system  design,  the  Computerized  Biomechanical 
Man-Model  (COMBIMAN)  is  a  valuable  tool.  The  heart  of  COMBIMAN  is  an 
anthropometric  and  biomechanical  data  base  consisting  of  measurements  taken 
from  10,000  Air  Force  men  and  women.  COMBIMAN  allows  the  designer  to  enter 
data  on  a  proposed  crew  system  configuration  and  then  exercise  the  data 
base  to  determine  such  things  as  reach  envelopes,  lines  of  sight,  and  body 
fit  for  a  variety  of  human  sizes  and  postures.  CSERIAC  will  be  able  to 
either  provide  COMBIMAN  data  developed  for  a  user's  application  or  Provide 
a  copy  of  the  model  for  installation  on  the  user's  computer  system. 

Anthropometric  and  biomechanical  data  from  COMBIMAN  and  other  sources  can 
also  be  provided  by  CSERIAC  in  forms  such  as  data  tables,  and  drawingboard 
templates  to  meet  a  particular  user's  need. 
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3.3.2 


Perception  and  Performance  Information 


The  AAMRL  Human  Engineering  Division  Is  completing  a  major  program  titled 
"Integrated  Perceptual  Information  for  Designers  (IPID)."  One  of  Its  major 
products  Is  the  IPID  Engineering  Design  Compendium,  a  comprehensive  collec¬ 
tion  of  human  perceptual  and  performance  data  Intended  to  be  a  major  guide 
for  engineering  design  of  crew  systems.  This  document,  actually  a  collec¬ 
tion  of  Individual  guides,  is  Intended  to  be  periodically  updated.  AAMRL 
has  expressed  the  Intent  to  have  the  proposed  CSERIAC  take  responsibility 
for  maintaining  the  configuration  of  the  compendium. 

3.3.3  Computer  Aided  Design  Incorporating  CSE  Information 

An  AAMRL* program,  "Cockpit  Automation  Technology  (CAT),"  Is  developing  a 
Computer  Aided  Design  (CAD)  system  that  Incorporates  ergonomic  data  and 
principles.  Program  personnel  have  endorsed  the  Idea  that  the  proposed 
CSERIAC  maintain  and  disseminate  the  ergonomic  data  base  that  Is  the  heart 
of  the  CAT  CAD  system. 

3.3.4  Workload  Assessment  Methodology 

AAMRL  has  developed  a  comprehensive  workload  test  battery.  Baseline  per¬ 
formance  data  for  the  battery,  as  well  as  methodological  Information  for 
using  the  workload  test  battery  can  be  distributed  to  users  upon  request  to 
CSERIAC. 


3.3.5  Presence  of  AAMRL  at  Wright-Patterson  Air  Force  Base 

WPAFB  itself  is  the  largest  DoD  center  for  military  aircraft  research  and 
development.  Most  of  the  laboratories  and  activities  at  WPAFB  are  con¬ 
cerned  with  aircraft  and  space  vehicle  systems  development  that  would  both 
draw  on,  as  well  as  contribute  to  the  CSERIAC  data  bases.  A  strong  working 
relationship  would  easily  develop  between  the  professional  personnel  at 
WPAFB  and  the  CSERIAC  personnel  as  an  extension  of  the  existing  relation¬ 
ship  between  AAMRL  and  the  other  WPAFB  laboratories  and  offices.  AAMRL 
personnel  constitute  a  large  potential  pool  of  expertise  that  would  be  a 
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valuable  resource  for  CSERIAC.  Because  WPAFB  is  near  the  geographic  center 
Of  the  continental  U.S, ,  on  the  average  it  would  provide  the  greatest  ease 
Of  physical  access  for  Individuals  to  use  CSERIAC  resources  on  site. 

AAMRL  has  facility  space  available  for  CSERIAC.  Moreover,  the  AAMRL  com¬ 
puter  facilities  support  programming  languages  for  data  base  development, 
as  well  as  accession  and  retrieval.  These  computer  resources  would  be 
available  for  use  by  the  CSERIAC  staff  during  the  start-up  phase  before 
CSERIAC* $  own  data  processing  equipment  is  installed. 


Section  4 
C SERI AC  SCOPE 


The  subject-matter  scope  of  CSERIAC  Mill  encompass  CSE  Information  and  data 
that  bear  directly  on  aerospace  crew  system  research,  development,  design, 
and  engineering.  The  data  from  the  questionnaire  survey  (Appendix  A)  sup¬ 
port  the  Importance  of  the  CSE  topics  listed  In  Table  1  to  the  respondents' 
work.  The  topics  are  grouped  In  five  areas  that  reflect  differences  In 
emphasis  of  users  of  CSE  Information. 

TABLE  1.  PRINCIPAL  CSERIAC  INFORMATION  TOPICS 


BIOMEDICAL 


HUMAN  PERFORMANCE 


0  Loading 

Stress  and  Fatigue 
Motion  and  Vibration 
Hypoxia  and  Gas  Mixture 
Thermal  Effects 
Hyperbarla 

Chemical,  Biological, 
anti  Radiation  Effects 
Anthropometry  and  Biomechanics 


Sensory  Factors 
Perception 

Information  Processing 
Cognitive  Processes 
Individual  Differences 
Learning 
Motor  Control 
Communication 


METHODOLOGIES 


.<  Analysis 
Workload  Analysis 
Systems  Engineering 
Func  »on  Allocation/Analysis 


Performance  Measurement 
Test  and  Evaluation 
Statistical  Analysis 
Human  Performance  Modeling 


DESIGN  AND  ENGINEERING 


Displays 

Controls 

Multifunction  Di splays-Controls 
Communi cations 
Voice  Technology 
Life  Support 


Ejection/Survival  Systems 
Personal  Equipment 
Human-System  Integration 
Crew  Station  Layout 
Vehicle  Handling  Qualities 
Guidance  and  Control 


SPECIAL  TOPICS 


Simulators  Automation 

Multi-Crew  Member  Interaction  Artificial  Intelligence 

Safety/Accident  Prevention  Standards 
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A  few  of  the  topics  require  explanation.  The  topic,  simulators,  refers  to 
engineering  simulation  to  support  research  and  development;  training  simu¬ 
lators  are  not  Included.  Training  related  information  is  available  from 
the  Defense  Training  Data  and  Analysis  Center  (TDAC).  Safety/Accident  Pre¬ 
vention  Includes  only  Information  related  to  human  error  in  system  and 
equipment  operation  that  Implies  a  design  fault.  Automation  and  Artificial 
Intelligence  are  limited  to  the  operational  consequences  for  crew  members; 
they  do  not  Include  the  mechanisms  by  which  automation  and  artificial 
intelligence  are  achieved. 

4.1  LIMITATIONS 

The  proposed  CSERIAC  will  confine  Its  domain  of  interests  to  CSC  topics  for 
military,  aerospace,  ground,  and  water  based  systems  Specifically 
excluded  are  training  and  training  effectiveness,  maintainability,  crew 
selection,  tactics,  mission  analysis,  medicine,  and  safety  except  as  noted 
above. 

The  preponderance  of  information  and  data  will  be  drawn  from  sources  that 
deal  specifically  with  military  systems.  However,  the  distinction  between 
military  and  nonmilitary  systems  will  not  be  applied  to  sources  of  basic 
or  fundamental  principles  and  data.  While  foreign  CSC  information  is 
within  the  domain  of  CSERIAC,  Intelligence  information  will  be  excluded  as 
required  by  the  implementing  regulation  (Department  of  Defense,  1984). 

4.2  FUNCTIONS 

The  essential  operational  functions  for  CSERIAC  to  fulfill  its  mission 
requirements  are: 

4.2.1  Operational  Functions 

1.  Identify  sources  of  existing  documents  and  unpublished  infor¬ 

mation  and  data,  models,  data  bases,  methodologies  and  software 
that  are  relevant  to  CSE.  These  sources  include  government  and 
private  organizations  such  as  the  Naval  Air  Development  Center, 


the  Air  Force  School  of  Aerospace  Medicine,  the  Army  Human  Engi¬ 
neering  Laboratory,  the  Army  Aeromedical  Research  Laboratory, 

Army  Research  Institute,  NASA  Ames  Research  Center,  and  Johnson 
Space  Center,  and  major  military  system/ subsystem  manufacturers. 

2.  Identify  potential  sources  of  new  CSE  information  and  establish  a 
relationship  to  assure  the  CSERIAC  will  receive  It  as  soon  as 
available.  Test  and  evaluation  reports  and  data  relevant  to  CSE 
are  particularly  valuable  types  of  CSE  Information  that  should  be 
collected  by  CSERIAC. 

3.  Acquire  all  Ley  CSE  Information  essential  for  analysis  and  review 
purposes.  These  would  include  existing  handbooks  and  standards, 
and  descriptions  of  data  bases,  models  and  CSE  related  design 
software.  Technical  abstracts  of  potentially  relevant  technical 
reports  would  be  obtained  first  for  screening  purposes.  Physical 
acquisition  of  abstracts  would  not  be  necessary  for  those 
accessible  as  computer  data  bases* 

4.  Systematically  screen,  analyze  and  evaluate  accessible  documents 
for  CSE  relevance  by  topic  area  and  abstract  documents,  as  neces¬ 
sary,  for  CSE  information  purposes.  Screen  available  data  bases, 
models  and  methodologies  for  currency,  validity,  and  relevance  to 
crew  systems  research  and  development  efforts. 

5.  Develop  computer-based  document  and  data  bibliographic  and 
retrieval  systems  with  cross  references  and  multiple  Indexes, 
e.g.,  keyword,  topic,  application. 

6.  Institute  control  procedures  for  access  and  release  of  classified 
and  restricted  information. 

7.  Develop  procedures  for  updating  and  revising  CSE  information  and 
data  compi lat ions  and  the  purging  of  obsolete  materials. 
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8*  Provide  required  storage  for  classified ,  restricted,  and  unre¬ 
stricted  documents  and  data. 


9.  Establish  liaison  with  other  lACs  and  Information  centers  that 
have  some  relationship  to  CSE.  The  lACs  Include  SURVIAC,  svic, 
TACTEC.  Other  Information  centers  are  TDAC  and  NATRIS. 

10.  Develop  a  file  of  expert  consultants  In  the  CSE  topic  categories 
who  are  available  to  assist  In  analysis  and  evaluation  tasks  or 
assist  in  responding  to  user  Inquiries. 

11.  Develop  categorized  lists  of  actual  and  potential  CSE  information 
users  and  generators. 


12.  Establish  a  user  fee  schedule  for  publications  and  services. 


♦•2.2  Service  Functions 

1.  Publicize  CSERIAC  holdings  and  services  through  periodic  news¬ 
letters,  current  awareness  bulletins,  and  existing  Information 
dissemination  channels  within  the  DoD. 

2.  Publish  current  awareness  and  state-of-the-art  reviews  of  CSE 
topics  on  a  regular  basis. 

3.  Conduct  blbliograhlc  searches  in  response  to  user  reouest  ar.d 
provide  citations  and/or  abstracts  as  needed.  CSERIAC  will  not 
reproduce  or  disseminate  original  source  documents  other  than 
those  It  produces  itself. 

4.  Develop  special  analysis  reports  requested  by  users. 

5.  Provide  quick  response  to  simple  information  inquiries. 
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6.  Maintain  configurations  and  provide  access  services  and  copies  of 
special  CSE  computer-based  models  such  as  COMBIMAN  as  requested 
by  users. 

7.  Upon  request  from  a  DoD  agency,  organize  and  conduct  symposia, 
seminars,  or  workshops. 

8.  Provide  users  direct  contact  Information  to  expert  sources  when 
requested. 

9.  Perform  other  necessary  tasks  to  be  responsive  to  user  needs  for 
CSE  Information  and  to  appropriately  disseminate  CSE  Information, 
data  base  extractions,  models,  methodologies,  and  software  to 
support  DoD  aerospace  crew  systems  research,  development,  design, 
and  engineering  efforts. 

4.3  STAKT-UP  AND  DEVELOPMENT 

The  start-up  of  CSERIAC  will  be  planned  to  provide  CSE  information  services 
to  the  user  community  as  soon  as  practical.  An  announcement  of  the  exis¬ 
tence,  purpose  and  services  of  CSERIAC  will  be  widely  distributed  two 
months  in  advance  of  the  date  established  for  CSERIAC  to  begin  to  provide 
services.  Almost  all  respondents  to  the  survey  questionnaire  provided 
their  names  and  addresses  to  Indicate  they  wished  to  be  Informed  of  the 
availability  of  CSERIAC  services.  This  list,  as  well  as  others,  will  be 
used  to  distribute  the  announcement  of  the  availability  of  CSERIAC' s 
services. 


Section  5 

REQUIRED  RESOURCES 


The  physical  resources  end  personnel  requtrmnents  to  begin  initial  opera¬ 
tions  of  CSERIAC  are  predictable  from  other  IAC  start-ups.  The  potential 
user  community  easily  exceeds  3000  Individuals  from  500  or  more  DoD  and  DoD 
contractor  organizations.  Based  on  the  results  of  the  questionnaire  survey 
(Appendix  A),  the  expected  number  of  requests  per  year  to  CSERIAC  is 
approximately  4,000.  Requests  fulfilled  during  the  first  year  are  likely 
to  be  fewer  because  of  the  minimum  user  services  available  during  the 
start-up  phase.  The  potential  number  of  documents  containing  CSE  informa¬ 
tion  Is  probably  In  excess  of  20,000.  However,  those  of  greatest  Impor¬ 
tance  probably  number  between  1,000  to  5,000.  Approximately  2,500  new 
documents  per  year  will  require  screening.  In  addition,  five  to  ten  of  the 
most  well  known  and  useful  models  of  human  performance  and  several  types  of 
CSE-related  design  methodologies  and  software  packages  will  require 
screening.  Based  on  the  experience  of  other  IACS,  an  initial  staff  of  four 
persons  should  be  adequate  to  meet  start-up  needs  during  the  first  year. 

5.1  EXPERTISE 

Operational  and  technical  expertise  will  be  required  for  CSERIAC.  Opera¬ 
tional  personnel  will  consist  of  Information  specialists  with  experience  in 
both  manual  and  computer-based  procedures  for  infennation  storage,  acces¬ 
sion  and  retrieval  functions.  Technical  personnel  will  be  subject  matter 
experts  In  CSE.  To  provide  expertise  across  the  range  of  disciplines  that 
comprise  CSE  information,  at  least  three  Individuals  with  education  and 
experience  in  biomedical,  behavioral,  and  engineering  fields  respectively, 
will  be  required  eventually.  The  technical  experts  need  not  be  full  time 
employees  of  CSERIAC.  A  group  of  Government  or  non-Gove rnment  experts  can 
be  used  on  a  part-time  basis.  The  amount  of  time  required  would  vary  with 
the  nature  of  the  requests  received  from  the  users.  Having  several  part- 
time  technical  experts  available  on  an  Mas  needed"  basis  has  the  advantage 
of  drawing  on  greater  specificity  of  expertise  for  any  particular  CSE 
information  request.  Some  form  of  consulting,  subcontract  or  other 


arrangement  will  be  made  In  advance  to  allow  rapid  involvement  of  a  part 
time  technical  expert  when  required. 

5.2  STAFFING 


Existing  IACS  operate  with  from  5  to  35  personnel  (Bernier,  Mower,  and 
Horton,  1982)  plus  help  from  part-time  technical  personnel.  The  estimated 
staffing  requirements  for  the  first  year  of  CSERIAC  operation  are  estimated 
to  be  4  full-time  personnel  plus  part  time  expert  support  equivalent  to  one 
additional  person.  The  recommended  staff  for  the  first  year  would  consist 
of  the  following  (*  Indicates  full-time;  #  Indicates  part-time) 


Position 

*  Facility  Manager 

*  Senior  CSE  Analyst 

#  Head  of  Information 
Services 

#  CSE  Information 
Special i st 


Responsibilities 

Manager  and  lead  technical  expert 

Customer  point  of  contact;  technical 
expert;  security 

Information  and  Library  Science  expert; 
document  acquisition,  control,  and 
Indexing;  bibliographic  procedures 

CSE  information  location,  abstraction  and 
report  development;  bibliographic 
searches 


*  Data  Base  Progranmer  Computer  system  data  bases;  entry, 

search,  and  accession  programs;  model 
configuration  control 

*  Technical  Secretary  Abstract  and  report  typing;  corres¬ 

pondence;  publication  mechanics;  filing; 
mailing;  telephone;  bookkeeping 


This  level  of  staffing  and  mix  of  responsibilities  has  precedent  in  the 
recently  established  SURVIAC.  Four  full-time  staff  members  including  the 
facility  manager  plus  part-time  help  equivalent  to  an  additional  person  are 
necessary  during  the  first  year  to  bring  the  CSERIAC  to  operational  readi¬ 
ness.  The  initial  effort  will  essentially  involve  physical  set-up,  estab¬ 
lishing  procedures,  preparing  data  base  software,  and  obtaining  and 
screening  the  Initial  source  materials  such  as  documents,  compendiums, 
bibliographies,  models,  and  design  support  software. 


In  the  second  year,  the  CSERIAC  staff  should  expand  to  eight  people  to  both 
continue  the  development  of  CSERIAC  and  provide  user  services.  In  addition 
to  the  four  full-time  personnel  Indicated  above,  the  Head  of  Information 
Sciences,  two  CSE  Information  specialists  and  an  Administrative  Secretary 
would  become  full-time  employees.  Part-time  technical  help,  equivalent  to 
two  full-time  personnel  would  be  required  for  responding  to  user  requests 
for  analysis  services,  obtaining  model  derived  data,  copies  of  models  or 
software,  and  information  on  CSE  methodology.  Curing  the  second  and  subse¬ 
quent  years,  the  presence  of  several  CSE  technical  experts  on  the  CSERIAC 
staff  Is  justified  because  of  the  nature  of  CSE  information.  Almost  all 
Information  requests  will  require  significant  analysis  effort  because  CSE 
Information  Is  rarely  available  from  original  source  documents  in  the  orm 
of  tables,  graphs,  or  other  succinct  formats.  Responses  to  seemingly 
simple  Inquiries  can  Involve  substantial  effort  to  search  and  evaluate  the 
applicability  of  CSE  Information  derived  in  a  context  that  Is  simi  lar,  but 
not  exactly  the  same  as  the  one  of  concern.  Also,  providing  the  use  of,  or 
copies  of  human  performance  irodels  and  design  software,  as  well  as  pro¬ 
viding  CSE  methodological  assistance  will  require  the  availability  of 
special  expertise. 

After  the  second  year,  as  the  service  demands  and  scope  of  services  expand, 
additional  staff  members  will  be  required.  A  reasonable  estimate  is  a 
staff  of  fourteen  people  during  the  fourth  year  of  operation. 

5.3  FACILITIES 

The  facilities  requirements  Include  space  for  desks,  document  and  other 
media  storage  and  the  computer  systems,  peripherals,  and  terminals. 
Approximately  3300  square  feet  of  space  will  be  required  initially.  Equip¬ 
ment  requirements  include  standard  office  furnishings,  the  computer  equip¬ 
ment,  storage  shelves,  and  telecommunication  equipment.  Since  only  a  very 
limited  amount  of  CSE  Information  is  expected  to  be  classified,  security 
storage  requirements  should  be  very  modest.  Also,  since  there  is  no  fore¬ 
seen  need  for  electronic  storage  of  classified  information  (it  will  be 
handled  manually)  the  computer  systems  will  not  need  to  meet  TEMPEST 
requirements. 
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5.4 


MANAGEMENT 


As  a  DoD  IAC,  CSERIAC  will  be  administratively  managed  by  the  Defense 
Logistics  Agency  (DLA).  DLA,  through  the  competitive  bid  process,  will 
select  the  contractor  to  run  CSERIAC.  If  AAMRL  becomes  the  host  organiza¬ 
tion  for  CSERIAC,  it  will  provide  a  program  manager/technical  director.  A 
steering  committee  composed  of  representatives  from  the  DoD  user  community 
will  be  established  to  provide  technical  guidance  for  the  operation  and 
functions  of  CSERIAC.  The  Facility  Manager  selected  by  the  contractor  will 
have  responsibllty  for  the  day-to-day  management  of  CSERIAC  and  the  Impor¬ 
tant  task  of  liaison  with  the  user  community  both  to  maintain  awareness  of 
their  needs  and  to  make  CSERIAC  known  to  a  wider  range  of  potential  users. 

5.5  FUNDING 

CSERIAC  operations  will  be  funded  by  two  sources,  DTIC-AI  and  users  who  pay 
fees  for  services.  During  the  first  several  years  of  operation,  DTIC-AI 
will  provide  core  funds  to  sustain  basic  CSERIAC  operations  and  services. 
Beginning  in  the  second  year,  additional  revenues  will  be  generated  from 
user  fees  that,  in  turn,  will  allow  expansion  of  the  scope  of  CSERIAC  ser¬ 
vices.  The  core  funding  from  DTIC-AI  is  expected  to  increase  by  approxi¬ 
mately  25%  from  year  to  year  during  the  first  several  years.  The  increases 
will  be  necessary  to  permit  a  more  rapid  expansion  of  services  than  would 
be  possible  If  all  growth  were  to  be  funded  from  user  fees  alone.  Income 
from  user  fees  is  anticipated  to  nearly  triple  from  the  second  to  third 
years  of  opeation  and  to  double  from  the  third  to  fourth  years  of  opera¬ 
tion  . 

The  results  of  the  questionnaire  survey  indicate  that  78.5%  of  the  poten¬ 
tial  users  are  willing  to  pay  reasonable  fees  for  CSERIAC  services.  This 
high  percentage  of  users  willing  to  pay  fees,  coupled  with  the  high  usage 
expected  (4,000  or  more  requests  per  year),  means  that  the  largest  portion 
of  fundi  ny  to  support  CSERIAC  operations  should  eventually  come  from  user 
fees. 
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A  lesson  learned  from  the  experience  of  other  IACS  Is  to  aggressively 
pursue  obtaining  annual  subscriptions  from  the  user  community  for  cseriac 
services  and  reports.  Subscription  fees,  as  well  as  core  funding  from 
DTIC'AI,  are  the  dependable  sources  of  Income  that  allow  operational 
stability  and  budgetary  planning  from  year  to  year. 
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Section  6 

IMPLEMENTATION  PLAN 

The  descriptions  of  the  phases  of  Implementation  and  operation  of  CSERIAC 
are  intended  to  outline  a  general,  orderly  process  necessary  for  CSERIAC  to 
attain  its  goal  and  objectives.  The  plans  for  these  phases  are  certain  to 
be  developed  in  great  detail  by  the  contractor  In  the  response  to  the 
Request  for  Proposal  to  operate  CSERIAC. 

Of  great  Importance  is  the  need  to  develop  the  CSERIAC  resources  and 
services  In  such  a  way  that  its  credibility  and  quality  of  service  to  the 
user  community  are  established  at  the  outset  and  maintained  in  the  years  to 
come.  It  is  better  to  gradually  Increase  capabilities  over  the  entire 
spectrum  of  CSE  information  services  to  be  provided  than  to  build  full 
capabilities  in  some  subareas  early  and  others  later.  If  CSERIAC  Initially 
provided  services  for  only  a  subset  of  its  range  of  topics  or  forms  of 
information  services  it  would  discourage  users  with  other  topic  Interests 
or  needs  by  fostering  the  erroneous  Impression  that  CSERIAC  is  limited  in 
its  topic  coverage  and  types  of  services  provided. 

6,1  GOALS  AND  OBJECTIVES 

The  goal  of  CSERIAC  is  to  provide  the  wide  spectrum  of  aerospace  CSE  infor¬ 
mation  services  detailed  in  Section  4.2.2  to  DoD  and  DoD  contractors.  Its 
objectives  are  to  become  the  acknowledged  central  source  for  up-to-date, 
reliable  CSE  information  provided  in  a  timely  manner  in  a  form  specifically 
tailored  to  meet  a  user's  application  needs.  In  achieving  these  objectives 
the  CSERIAC  will  fulfill  a  long-standing  critical  need  to  Improve  the 
incorporation  of  CSE  information  In  the  aerospace  crew  system  design  and 
engineering  processes.  It  will  also  assure  greater  usage  of  CSE  informa¬ 
tion  by  relieving  the  burden  on  the  user  to  seek,  analyze,  and  interpret 
needed  CSE  information. 
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6.? 


CSCRIAC  SET-UP  PHASE 


QmHri  tht  $ft-up  phase,  expected  to  be  about  one  year  In  duration,  the 
principal  activities  of  the  CSERIAC  staff  will  be: 

1.  Physically  prepare  the  facility  Including  ordering  of  office 
furniture,  computer  system,  storage  shelves,  etc.  Facilities  and 
computer  resources  provided  by  AAMRL  will  minimize  the  time 
required  before  user  services  can  be  provided. 

2.  Establish  the  key  operational  procedures,  including  the  configu¬ 
ration  of  the  data  bases,  source  identification  and  access 
methods,  in-house  software  requirements  for  entry,  search,  and 
retrieval,  configuration  control  and  use  of  models,  testing  of 
design  support  software,  and  handling  of  customer  requests. 

3.  Develop  a  time-line  plan  for  announcements,  initial  products  and 
services  to  be  provided. 

4.  Acquire  core  documents,  such  as  CSE  handbooks,  Military  Standards 
relevant  to  CSE,  key  technical  reports  and  other  documents  in 
limited  number.  Install,  or  develop  access  methods  for,  avail¬ 
able  models  such  as  CQMBIMAN. 

5.  Identify  sources  of  published  CSE  information,  as  well  as  unpub¬ 
lished  test  and  evaluation  reports  relevant  to  CSE  and  initiate 
processes  to  receive  documents,  data,  models,  software,  and  other 
materials  from  these  sources. 

6.  Identify  major  collections  of  existing  CSE  information  and 
obtain.  If  possible,  descriptions  of  holdings  and  access 
procedures. 

7.  Identify  and  establish  access  to  existing  CSE  computer  data  base 
collections,  models,  and  design  support  software. 
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8.  Develop  lists  of  potential  users. 

9.  Begin  systematic  review  of  bibliographies,  abstracts  and  docu¬ 
ments  for  relevance  to  planned  publications  and  anticipated  user 
requests.  Begin  abstraction  of  documents  and  development  of 
In-house  bibliographies.  Review  model  descriptions  and  reports 
and  software  that  support  CSE  design  efforts. 

10.  Establish  agreements  with  part-time  technical  experts. 

11.  Solicit  transfer  of  collections  of  documents,  data,  models,  and 
software  judged  to  be  valuable  resources  for  CSER1AC. 

12.  Distribute  announcements  In  advance  of  Initial  service  date  with 
description  of  publications,  products  and  services  available. 

13.  Establish  working  relationship  with  other  lACs. 

6.3  CSERIAC  INITIATION  OF  SERVICES 

The  main  objective  during  this  second  phase  Is  to  establish  the  credibility 
and  worth  of  CSERIAC  by  providing  services  and  dissemination  of  publica¬ 
tions,  computer  base  models,  software  and  methodological  Information.  The 
plan  for  the  second  phase  should  Include: 

1.  Offering  of  bibliographic  and  special  analysis  services  in 
response  to  user  requests. 

2.  Publication  and  dissemination  of  topical  bibliographies,  a  news¬ 
letter,  and  one  or  more  current  awareness  reviews  of  high 
interest  topics. 

3.  Provide  copies  and/or  access  to  use  of  models  and  design  support 
software,  and  specialized  data  base  extractions. 
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4.  Continuation  of  the  search,  evaluation  and  abstraction  of  rele¬ 
vant  CSE  source  documents  and  the  development  of  Indexed  bibli¬ 
ographies.  Continuation  of  the  development  and  acquisition  of 
data  bases,  models,  and  design  support  software. 

5.  Regular  publication  of  a  newsletter,  current  awareness  reviews, 
and  current  awareness  bibliographies. 

6.  Announcement  of  a  subscription  plan  for  publications  and 
services,  and  initiation  of  efforts  to  encourage  users  to  take 
advantage  of  the  program. 

7.  Development  and  implementation  of  a  mechanism  to  receive  user 
opinions  on  the  quality  of  service  and  topics  of  interest  to 
Improve  CSERIAC  services  to  the  user  community. 

8.  Establishment  of  a  mechanism  to  permit  direct  telecommunication 
queries  by  users  of  data  bases  of  unclassified  and  unrestricted 
documents. 

By  the  end  of  the  second  phase  CSERIAC  should  be  a  full  service  IAC  pro¬ 
viding  needed  CSE  information  services. 

6.4  CSERIAC  CONTINUED  DEVELOPMENT 

The  activities  outlined  for  the  second  phase  will  continue  in  successive 
years.  Expansion  of  staff  and  services  are  likely  to  occur  as  demand  for 
services  and  revenues  from  user  fees  increase.  Additional  activities 
CSERIAC  could  undertake  in  future  years  include: 

1.  Support  of  revision  and  development  of  Military  Standards  and 
Specifications  relevant  to  CSE. 

2.  Conduct  symposia  and  workshops  on  selected,  high  interest  topics. 
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3.  Develop  standard  descriptions  and  Instructions  for  CSE 
methodologies. 

4.  Develop  standard  anthropometric  and  biomechanical  and  human  per¬ 
formance  models,  and  CSE  design  support  software.  Provide  copies 
to  users  on  request  and  establish  telecommunication  access 
methods  to  models  resident  at  CSERIAC. 

5.  Publish  a  CSE  Journal. 

6.  Update  established  key  reference  documents  such  as  the  IP1D 
Engineering  Data  Compendl an. 
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Section  7 

BENEFITS  OF  A  DOO  CSERIAC 


A  DoD  CSERIAC  would  provide  several  benefits  to  the  DoD  and  other  govern¬ 
ment  and  Industry  community  of  users. 

1.  Increase  the  utility  and  transfer  of  CSE  technical  Information  to 
researchers,  system  developers,  and  program  managers. 

2.  Provide  a  centralized  source  of  current  CSE  information,  data, 
models,  support  software,  and  CSE  methodologies  for  design  and 
evaluation  of  aviation  and  space  crew  systems. 

3.  Serve  as  a  repository  of  unpublished  data  from  government  test  A 
evaluation  programs  and  systems  development  tradeoff  studies. 

4.  Minimize  the  duplication  of  CSE  programs  by  serving  as  a  OoO 
focal  point  for  Information  on  past  and  present  programs  related 
to  CSE  technology. 

5.  Provide  analysis  services  for  scientific  and  technical  informa¬ 
tion  In  the  CSE  area. 

6.  Promote  standards  In  the  collection,  analysis  and  use  of  CSE 
technical  information,  data,  models,  software,  methodologies,  and 
other  CSE  design  support  tools. 

7.  Develop  new  analytical  methods  for  evaluating  crew  systems 
design. 

8.  Assist  program  managers  and  other  decision-makers  in  evaluating 
the  human-crew  system  interface. 

9.  Contribute  to  effective  system  design  and  evaluation  throuyh  con¬ 
tinued  selection,  analysis,  and  dissemination  of  pertinent  CSE 
information. 
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Appendix  A 

ANALYSIS  OF  QUESTIONNAIRE  SURVEY  TO  DETERMINE 
THE  NEEDS  AND  REQUIREMENTS  FOR  A  CREW  SYSTEMS 
ERGONOMICS  INFORMATION  ANALYSIS  CENTER  (CSERIAC) 


1.1  BACKGROUND 

Early  In  1986,  a  14-Item  questionnaire  was  developed  to  survey  opinions  of  1 

the  potential  user  community  on  the  need  for  a  Crew  Systems  Ergonomics  I 

(CSE)  information  Analysis  Center  (IAC).  The  questionnaire  solicited  I 

information  on  topics  and  services  of  Interest,  expected  usage,  and  the 
work  and  educational  background  of  the  respondents.  In  May  1985, 

3705  questionnaires,  with  an  Introductory  letter  and  a  description  of 
purpose  and  services  provided  by  lACs,  were  mailed  to  Individuals  likely  to 
have  an  Interest  in  CSE.  Appendix  B  contains  the  complete  questionnaire 
and  the  accompanying  materials  included  In  the  mailing. 

1.2  QUESTIONNAIRE  OBJECTIVES  AND  DEVELOPMENT  ; 

The  questionnaire  was  designed  to  determine  If  proposing  the  establishment 
of  a  CSERIAC  would  be  worthwhile  and  to  obtain  the  information  necessary  to 
justify  Its  proposed  mission,  scope  and  level  of  operation.  The  Imple¬ 
menting  regulation  for  lACs  (Department  of  Defense,  1984)  was  reviewed  to 
be  certain  that  the  necessary  supporting  data  would  be  obtained  from  the  ; 

questionnaire  returns.  The  specific  objectives  of  the  questionnaire  were 
to  determine: 

1.  Perceived  need  for  a  central  source  of  aerospace  CSE  information  j 

services.  j 

I 

I 

I 

2.  Scope  of  CSE  topics  of  interest.  ; 


3.  Nature  of  current  problems  with  CSE  information. 


4.  CSE  information  services  desired. 
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5.  Employment  and  educational  background  of  respondents. 

6.  Expected  volume  of  requests  to  CSERIAC  and  the  effect  of  fees  on 
usage. 

A  draft  questionnaire  was  prepared  that  met  the  Information  objectives.  To 
help  maximize  the  number  of  returns,  the  questionnaire  was  limited  to  four¬ 
teen  questions.  The  draft  questionnaire  was  sent  to  seventeen  Individuals 
within  the  DoD  and  Industry  who  are  knowledgeable  In  both  CSE  and  question¬ 
naire  construction.  These  experts  were  asked  to  comment  on  both  the  con¬ 
tent  of  the  questionnaire  as  well  as  Its  design.  All  seventeen  provided 
written  critiques.  A  final  version  was  prepared  based  on  the  suggestions 
of  these  Individuals  and  subsequently  reviewed  and  approved  by  AAMRL. 

1.3  DEVELOPMENT  OF  WILING  LIST  OF  QUESTIONNAIRE  RECIPIENTS 

The  mailing  list  was  generated  from  membership  lists  of  four  organizations; 
The  Human  Factors  Society,  Divisions  19  (Military  Psychology)  and  21 
(Engineering  and  Applied  Experimental  Psychology)  of  the  American  Psycho¬ 
logical  Association,  The  Institute  of  Electrical  and  Electronics  Engineers 
(subscribers  to  Transactions  on  Systems,  Man  and  Cybernetics),  and  The 
Aerospace  Medical  Association  (members  who  Indicated  to  the  association  an 
Interest  in  human  factors).  Individuals  who  were  either  student  members  of 
the  professional  organizations  or  had  foreign  addresses  were  excluded  from 

!  the  source  lists. 

i 

I 

The  professional  organization  source  lists  were  supplemented  by  a  list  of 
j  associates  of  the  DOD  Human  Factors  Engineering  Technical  Advisory  Group 

and  a  list  compiled  from  review  of  DoD  organizational  charts  (positions 
likely  to  have  some  concern  for  CSE).  Ml  lists  were  cross-checked  to 
remove  duplicate  names  and  addresses. 
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2.1 


RESPONSE 


2.1.1  Returns 


The  recipients  Mere  asked  to  complete  and  return  the  questionnaire  within 
three  weeks.  By  June  21,  1985,  exactly  1000  (27%)  of  3705  questionnaires 
distributed  were  completed  and  returned.  The  high  percentage  of  returns 
was  particularly  gratifying  since  approximately  half  that  number  were 
expected  based  on  past  experience  with  questionnaires. 

2.1.2  Screening  the  Questionnaire  Data 

The  questionnaire  response  data  were  entered  Into  a  computer  data  base  for 
analysis.  The  first  step  was  to  screen  the  questionnaires  for  relevance. 
Question  3  asked  if  the  respondent  ever  uses  CSE  information  and  Question  4 
asked  if  the  respondent  ever  generates  CSE  Information.  One  hundred  and 
fifty-one  (151)  questionnaires  were  eliminated  on  the  basis  of  either  no 
response  to  questions  3  and  4  or  because  the  respondent  Indicated  that  he 
or  she  both  never  uses  CSE  Information  and  never  generates  CSE  Informa¬ 
tion.  One  questionnaire  was  eliminated  because  the  respondent  Indicated 
"retired**  on  Question  12  -  current  employment.  Since  a  major  goal  of  the 
questionnaire  was  to  classify  responses  by  DoD  and  non-DoD  employment 
categories,  an  additional  19  questionnaires  were  eliminated  due  to  the 
absence  of  any  response  to  Question  12  on  Current  Employment.  Thus,  the 
data  presented  in  the  accompanying  tables  and  figures  are  based  on  a  total 
sample  of  829  questionnaires  (22.4%  of  questionnaires  mailed). 

3.1  SUMMARY  OF  SURVEY  QUESTIONNAIRE  RESULTS 

Of  the  829  useable  questionnaires  (22%  of  the  3705  distributed)  received, 
30%  were  from  DoD  employees  and  70%  were  non-DoD  employees.  Approximately 
75%  of  the  respondents  are  Involved  in  Research  and  Development,  Management 
or  Test  and  Evaluation,  ano  have  educational  backgrounds  in  either  Behavi¬ 
oral  Science,  Engineering  or  Hunan  Factors.  The  current  work  and  educa¬ 
tional  background  of  the  respondents  did  not  appear  to  differ  substantially 
by  employment  category.  Ninety-seven  percent  (97%)  of  the  respondents 
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Indicated  they  use  CSE  Information  and  over  70%  indicated  they  generate  CSE 
Information.  This  result  validated  the  assumption  that  the  mailing  would 
reach  a  substantial  portion  of  persons  concerned  with  CSE  information.  It 
also  supports  the  contention  that  the  respondents  are  potential  users  of 
CSE  Information  services. 

Eighty-seven  percent  (87%)  of  the  respondents  Indicated  c  strong  perceived 
need  for  a  CSE  Information  center  and  67%  agreed  that  it  should  be  a  DoD 
sponsored  IAC.  Twenty-two  percent  (22%)  indicated  they  didn't  knew  if  the 
CSE  center  should  be  a  DoD  IAC.  This  implies  they  are  at  least  open  to  the 
possibility  that  CSERIAC  would  be  an  appropriate  means  to  provide  needed 
CSE  information  services. 

There  is  substantial  interest  in  almost  all  of  the  42  CSE  topics  that  were 
listed  in  the  questionnaire.  Only  6  topics  were  of  interest  to  less  than 
30%  of  the  respondents.  Three  of  the  low  interest  topics  are  in  the  bio¬ 
medical  area.  The  other  three  are  in  the  design  and  engineering  category. 

Journals  and  Technical  Reports,  obtained  either  by  direct  distribution  or 
from  DTIC  or  NTIS,  are  the  major  sources  of  CSE  information.  The  most  fre¬ 
quently  cited  problems  with  CSE  information  were  lack  of  awareness  of 
information  available,  lack  of  specificity  to  the  need,  poor  quality  of  the 
information,  and  delay  in  receiving  requested  information. 

State-of-the-art  reviews  and  quick  response  to  inquiries  were  the  most  fre¬ 
quently  cited  CSE  information  need  and  the  most  useful  forms  of  CSE  infor¬ 
mation  was  perceived  to  be  topical  reviews,  special  analysis  reports,  and 
study  summaries. 

Seventy-eight  percent  (78%)  of  the  respondents  would  be  willing  to  pay  for 
CSERIAC  services  and  about  75%  would  make  one  to  ten  requests  to  CSERIAC 
per  year.  Mean  number  of  requests  per  year  per  respondent  is  7;  the  median 
number  of  requests  per  respondent  is  3.5.  This  implies  that  CSERIAC  would 
receive  over  4000  inquiries  per  year. 


In  general,  among  the  829  respondents  to  the  questionnaire,  there  Is  a 
strong  perceived  need  for  aerospace  CSE  Information  services  and  two-thirds 
of  the  respondents  endorsed  the  establl shment  of  the  DoD  CSERIAC.  The  CSE 
information  problems  and  needs  Indicated  by  the  respondents  are  exactly  the 
kind  that  can  be  alleviated  and  filled,  respectively  by  CSERIAC.  There  was 
strong  interest  in  almost  all  CSE  topics  considered  to  be  within  the  scope 
of  CSERIAC' s  area  of  concern. 

The  DoD  and  non-DoD  respondents  are  predominantly  users  and  generators  of 
CSE  information,  work  in  research  and  development,  management  or  test  and 
evaluation,  and  have  educational  backgrounds  predominantly  in  behavioral 
science,  engineering,  and  human  factors. 

4.1  ANALYSIS  OF  RESPONSES  TO  INDIVIDUAL  QUESTIONS 

4.1.1  Presentation  of  the  Data 


The  data  presented  in  the  Tables  and  Figures  A-4.1  through  A-4.20  at  the 
end  of  this  section  are  divided  by  DoD  and  non-DoD  employment  categories. 
The  DoD  employment  category  Includes  active-duty  mi litary  and  DoD  civil 
service  personnel.  Because  of  the  small  number  of  respondents  (31  or  5%) 
in  the  non-DoD  federal  Government  employee  category,  their  response  data 
are  included  In  the  non-DoD  category.  A  preliminary  examination  of  the 
data  revealed  that  the  patterns  of  responses  of  the  non-DoD  Federal  employ¬ 
ees  did  not  differ  appreciably  from  those  of  either  the  DoD  employees  or 
civili an  personnel . 

The  graphical  data  are  generally  presented  in  terms  of  percent  of  responses 
within  each  of  the  two  employment  categories.  The  word  labels  on  the 
abscissa  of  each  graph  are  abbreviated  versions  of  the  response  alterna¬ 
tives  given  in  the  questionnaire.  The  response  data  for  each  question  are 
presented  in  descending  order  of  total  responses  to  each  alternative  for 
the  DoD  and  non-DoD  categories  combined.  Some  graphs  and  tables  include 
the  category  "Blank"  to  account  for  the  absence  of  any  response  to  a 
question. 
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4.1,2  Characteristics  of  Respondents 


Five  questions  asked  for  Information  about  the  respondents  employment, 
regular  work,  education,  and  their  use  and  production  of  CSE  Information. 

Question  12  asked:  "Please  Indicate  your  current  employment." 

Two  hundred  and  forty-nine  (249)  of  the  829  respondents  (30%  of  sample)  are 
military  or  civilian  employees  of  the  DoD,  and  the  remaining  080  (70%  of 
sample)  Individuals  are  either  In  non-DoD  civil  service  or  are  employed  In 
civilian  organizations.  Of  the  DoD  employees,  10%  are  active  duty  military 
personnel  and  20%  are  civil  service  personnel.  Of  the  non-DoD  employees 
49%  are  In  Industry,  12%  are  In  academia,  5%  are  self  employed,  and  4%  are 
In  non-DoD,  Federal  Civil  Service.  See  Table  and  Figure  A-4.1. 

Since  there  was  no  a  prior  knowledge  of  the  percent  of  questionnaires 
mailed  to  Individuals  In  the  different  employment  categories,  it  is  not 
possible  to  determine  if  there  was  a  differential  rate  of  return  by 
employment  category. 

Question  10  asked:  "Which  of  the  following  activities  best  describe  your 
regular  work?" 

Research  and  Development  Is  the  predominant  primary  work  of  both  the  DoD 
(40%)  and  non-DoD  respondents  (51%).  Management  (28%)  and  Test  and  Evalua¬ 
tion  (15%)  were  the  second  and  third  most  frequently  cited  primary  work 
categories  by  DoD  employees.  Design  (16%)  and  Management  (15%)  were  the 
second  and  third  most  frequently  cited  primary  work  categories  by  non-Dou 
employees.  Research  and  Development  (25%)  and  Test  and  Evaluation  (18%) 
were  the  most  frequently  cited  secondary  work  categories  by  both  DoD  and 
non-DoD  employees.  See  Tables  and  Figures  A-4.2  -  A-4.3. 

Question  11  asked:  "Which  of  the  following  discipline  areas  best  describe 
your  formal  educational  background?" 


A-6 


Behavioral  Science  (35%),  Engineering  (25%),  and  Human  Factors  (22%)  were 
the  most  frequently  cited  primary  educational  disciplines  by  both  OoO  and 
non-QoD  employees.  In  aggregate,  these  three  discipline  areas  account  for 
the  primary  educational  background  of  82%  of  the  respondents.  Seventy- 
seven  percent  (77%)  of  the  respondents  indicated  a  secondary  educational 
background.  Based  on  the  full  sample  of  829,  the  most  frequently  cited 
secondary  educational  disciplines  were  Behavioral  Science  (25%)  and  Human 
Factors  (12%).  See  Tables  and  Figures  A-4.4  -  A-4.5. 

Question  3  asked:  "How  frequently  do  you  use  CSE  Information  in  your 
work?1' 

Almost  all  (97%)  of  the  respondents  indicated  some  use  of  CSE  informa¬ 
tion.  Sixty  percent  (60%)  indicated  they  use  CSE  information  frequently  or 
very  frequently.  See  Table  and  Figure  A-4.6. 

Question  4  asked:  "Do  you  ever  generate  CSE  information?" 

About  73%  of  the  respondents  said  they  generate  CSE  information.  See  Table 
and  Figure  A-4.7. 

4.1.3  heed  for  CSE  Services 


Four  questions  asked  about  the  need  for  a  central  source  of  CSE  informa¬ 
tion,  how  often  requests  for  services  would  be  made  and  whether  potential 
users  would  be  willing  to  pay  reasonable  fees  for  these  services. 

Question  1  asked:  "Is  there  a  need  for  a  center  to  provide  crew  systems 
ergonomics  information  analysis  services?" 

Eighty-seven  percent  (87%)  of  the  respondents  believe  there  is  a  need  for 
such  a  center.  See  Table  and  Figure  A-4.8. 

Question  2  asked:  "If  YES  [to  Question  1],  should  the  center  be  a  DoD 
Information  Analysis  Center  (IAC)?" 


Slxty-Mven  percent  (67*)  of  the  respondents  (77*  of  those  saying  yes  to 
PI)  support  the  Idea  of  a  DoD  sponsored  CSERIAC.  See  Table  and 
Figure  A*4.9, 

Question  13  stated:  "Fees  would  be  charged  to  cover  the  costs  of  most  ser¬ 
vices  provided  by  a  crew  systems  ergonomics  Information  analysis  center 
(CSERIAC),  To  what  degree  would  this  affect  your  use  of  CSERIAC?" 

Sixty-nine  percent  (69*)  of  DoD  employees  and  83*  of  non-DoD  employees 
respondents  indicated  they  would  be  willing  to  pay  reasonable  fees  for 
CSERIAC  services.  Eighteen  percent  (18*)  of  all  respondents  stated  they 
would  use  CSERIAC  services  only  if  they  were  free.  Two  percent  (2%)  said 
they  probably  would  not  use  CSERIAC  services  at  all.  See  Table  and 
Figure  A-4,10. 

Question  14  asked:  "What  number  of  times  per  year  would  you  probably 
request  services  from  CSERIAC?" 

The  estimated  number  of  uses  per  year  of  CSERIAC  ranged  from  0  to  250.  The 
mean  number  was  7  times  per  year  and  the  median  number  was  3.5  times  per 
year.  Seventy-five  percent  (75*)  of  the  respondents  Indicated  they  would 
use  CSERIAC  between  1  to  10  times  per  year.  If  these  estimates  are  reli¬ 
able,  it  Implies  CSERIAC  would  receive  over  4000  requests  per  year  from  the 
questionnaire  respondents  alone.  See  Table  and  Figure  A-4.11. 

4.1.4  Current  Sources  of  CSE  Information 

One  question  asked  about  sources  of  CSE  Information.  Several  of  the  alter¬ 
natives  were  primary  source  documents,  and  responses  to  these  items  imply 
that  the  users  must  do  their  own  search  and  analysis  of  these  documents. 
Other  alternatives  were  of  a  kind  that  would  imply  that  some  services 
similar  to  those  that  would  be  provided  by  CSERIAC  were  being  used. 

Question  6  asked:  "Please  check  your  THRFE  most  important  sources  of  CSE 
information." 


A-8 


Journals  were  the  most  often  (54%)  cited  source  of  information  followed  by 
OTIC  (36%),  and  technical  reports  obtained  from  the  originating  source 
(33%)*  There  appear  to  be  important  differences  In  the  response  by  employ¬ 
ment  category.  OoO  employees  cited  technical  reports  from  the  originating 
source  (46%)  more  frequently  as  an  important  source  of  information  than 
journals  (36%).  The  reverse  was  true  for  non-DoD  respondents.  Sixty-two 
percent  (62%)  cited  journals  as  a  source  of  CSE  information  and  technical 
reports  were  cited  by  28%  of  the  non-DoD  respondents.  In  general,  the 
responses  indicated  that  much  of  the  burden  of  finding  and  extracting  CSE 
information  from  source  documents  was  borne  by  the  users  themselves.  See 
Table  and  Figure  A-4.12. 

4.1.5  Problems  Encountered  with  CSE  Information 

Problems  encountered  with  CSE  information  was  the  subject  of  one  ques¬ 
tion.  Responses  to  the  various  alternatives  imply  the  primary  types  of 
information  services  that  should  be  offered  by  CSERIAC.  The  question  asked 
the  respondent  to  rate  the  alternatives  that  apply  on  a  scale  from  one  (1) 
to  (4).  One  (1)  signifies  a  problem  that  is  most  important  or  is  encoun¬ 
tered  most  frequently.  Four  (4)  signifies  a  problem  that  is  least  impor¬ 
tant  or  is  encountered  least  frequently.  To  highlight  the  important  or 
frequent  problems,  the  ratings  of  an  alternative  with  either  a  one  (1)  or  a 
two  (2)  were  counted  (ratings  of  three  or  four  were  disregarded)  and  a  per¬ 
cent  figure  computed  for  each  employment  category  based  on  the  number  of 
respondents  in  each  category  (249  -  DoO  and  580  -  non-DoD). 

Question  7  asked:  "Which  of  the  following  problems  do  you  currently 
encounter  with  respect  to  CSE  information?" 

Awareness  of  information  available  was  rated  one  (1)  or  two  (2)  most 
frequently  (60%)  by  the  respondents.  The  second  and  third  most  important 
or  frequently  encountered  problems  were  lack  of  specificity  (40%)  and  non¬ 
existence  (37%)  of  the  required  information.  Where  to  obtain  needed  CSE 
information  was  the  least  often  cited  (25%)  CSE  information  problem.  See 
Table  and  Fi gure  A-4. 13. 
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CS£  Services  and  Forms  of  Information  Required 


Two  questions  asked  about  CSC  products  or  services  required  and  the  form  of 
CSC  Information  that  would  be  most  useful.  Both  questions  asked  the 
respondent  to  rate  the  alternatives  that  apply  on  a  scale  from  one  (1)  to 
(4)  as  described  in  the  previous  section.  Percent  responses  were  computed 
based  on  the  number  of  times  an  alternative  was  rated  either  one  (1)  or  two 
(2)  as  previously  described. 

Question  8  asked:  "Which  of  the  following  products  or  services  do  you 
require  to  satisfy  your  CSE  information  needs?" 

The  products  and  services  most  frequently  cited  were  state-of-the-art 
reviews  (64%),  quick  response  to  Inquiries  (42%),  and  technology  briefs 
(38%).  Training  materials  were  rated  least  frequently  as  an  important  or 
frequently  needed  product  or  service  (16%). 

Question  9  asked:  "With  regard  to  your  most  frequent  needs,  how  useful  are 
the  following  forms  for  CSE  Information?" 


Topical  reviews  (63%),  special  analysis  reports  (57%),  and  study  or  project 
summaries  (51%)  were  most  frequently  cited  as  being  the  most  useful  form  of 
information.  Computer-based  model  data  (21%)  was  least  frequently  cited  as 
a  useful  form  of  CSE  information.  Non-DoO  personnel  cited  the  above  forms 
of  CSE  information  in  the  order  given.  However,  DoD  personnel  cited 
special  analysis  reports  (74%)  as  useful  more  frequently  than  any  other 
form  of  CSE  information.  DoD  personnel  cited  study  or  project  summaries 
(55%)  and  topical  reviews  (54%)  second  and  third  most  frequently, 
respectively. 

4.1.7  Important  CSE  Topics 


One  question  asked  the  respondents  to  check  all  CSE  topics  that  were  impor¬ 
tant  In  their  work.  The  original  list  of  42  specific  topics  was  based  on 
the  scope  of  concerns  that  define  the  aerospace  crew  systems  domain.  The 
topics  were  grouped  in  five  categories:  Biomedical,  Human  Performance, 
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Methodologies,  Design  and  Engineering,  and  Special  Topics.  Differences  in 
the  number  of  responses  among  the  categories  would  be  an  indicator  of 
whether  CSERIAC  should  more  restrlcti vely  define  its  scope  of  concerns. 

Question  5  asked:  "Please  check  all  the  CSE  topics  below  that  are  impor¬ 
tant  in  your  work." 

All  42  of  the  topics  are  considered  to  be  important  to  the  work  of  a  sub¬ 
stantial  number  of  the  respondents.  However,  there  are  some  differences  in 
the  relative  importance  to  the  respondents  among  the  five  categories. 
Average  number  of  responses  per  category  (total  responses  within  a  category 
divided  by  number  of  items  In  the  category)  were  computed.  Sixty-seven 
percent  (67%)  of  the  respondents  had  Interest  In  human  performance  and 
methodologies  topics.  Special  Topics  and  Design  and  Engineering  topics 
were  important  to  51%  and  49%  of  the  respondents,  respectively.  Biomedical 
topics  was  the  category  that  was  least  frequently  (34%)  considered  impor¬ 
tant  to  the  work  of  the  respondents. 

Only  6  of  the  topics,  considered  Individually,  were  of  importance  to  less 
than  30%  of  the  respondents.  Three  each  of  the  low  frequency  of  importance 
topics  were  In  the  biomedical  area  (Thermal  Effects,  Hypoxia  and  Gas  Mix¬ 
ture,  and  Hyperbaria)  and  the  design  and  engineering  area  (Guidance  and 
Control,  Vehicle  Handling  Qualities  and  Ejection  and  Survival  Systems). 
Tables  and  Figures  A-4.16  -  A-4.20  present  the  response  data  for  each  of 
the  five  topic  categories. 

5.1  CONCLUSIONS 

1.  There  ts  strong  need  for  CSE  information  services  both  within  the 
DoD  and  industry. 

2.  A  DoD  CSERIAC  is  perceived  to  be  the  appropriate  mechanism  to 
provide  these  services. 
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Potential  users  are  willing  to  pay  fees  to  obtain  CSER1AC 
services. 

All  topics  associated  with  aerospace  CSE  are  of  Importance  to 
potential  users  of  C$Ef<!AC. 

There  will  be  heavy  demand  for  CSERIAC  services. 


NUMBER  OF  RESPONSES 
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TABLE  A- 4.2.  Primary  Job  Activity  of  Respondents* 
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Figure  A-4.3. 


Secondary  job  activity  of  respondents. 


Question  10 j  Which  of  these  activities  best  describe 
your  regular  work?  If  more  than  one 
applies#  please  use  1  for  primary  and  2 
for  secondary. 
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TABLE  A-4,4.  Educational  Background  of  Respor.dents-Primary . 
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TABLE  A-4.5.  Educational  Background  of  Respondents- 
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Figure  A- 4.6,  Respondents’  frequency  of  use  of  CSE 

information. 


Question  3:  How  frequently  do  you  use  CSE  information 
in  your  work? 


TABLE  A-4.6.  Respondents'  Frequency  of  Use  of  CSE  Information. 
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QUESTION  3:  How  frequently  do  you  use  CSE  information  in  your  work? 


Question  4:  Do  you  ever  generate  CSE  information? 
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Figure  A-4.8.  Respondents'  opinion  about  need  for  a 
CSE  information  center. 


Question  1:  Is  there  a  need  for  a  center  to  provide 
crew  systems  ergonomics  information 
analysis  services? 


TABLE  A- 4. 8 .  Respondents'  Opinion  About  the  Need  for  a  CSB  Information  Center 
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QUESTION  Is  is  there  a  need  for  a  center  to  provide  cxew  systems  ergonomics 
information  analysis  services? 
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Figure  A-4.9.  Respondents'  opinion  about  center  being 
a  DoD  IAC. 


Question  2:  If  YES  (to  question  #1),  should  the  center 
be  a  DoD  Information  Analysis  Center  (IAC)? 
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TABLE  A- 4.9.  Respondents'  Opinion  About  the  Center  Being 


fN  m  vo  » 

•  *  »  »  I 

r*»  >-i  vo  j 

vo  <n  i 


h 

in  i  A  r 


§ 


h  u> 


NlflO® 
•  i  <  » 

■*  VO 

VO  rvt 


in  tp  ov  o 

f'  N  ^  vf 

r*\  r-4 


HOrtOO 
•  ♦  *  • 
«*»  **  VO  to 
*h 


IN  o  o 
00  r-i  r-i 


J 

o 

c 

« 

4J  .* 

'  c 

m  C  (0 
O  O  0  r-l 
><  Z  Q  £0 


A- SO 


QUESTION  2x  If  YES  (to  question  #1),  should  the  center  be  a  DOD  Information 
Analysis  Center  (IAC)? 
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Figure  A-4.10.  Effect  of  fee  structure  on  predicted  use 

of  CSERIAC  by  respondents. 


Question  13: 


Fees  would  be  charged  to  cover  the  costs 
of  most  services  provided  by  CSERIAC.  To 
what  degree  would  this  affect  your  use  of 
CSERIAC? 
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table  A-4.10.  Effect  of  Fee  Structure  on  Estimated  Use  of  CSERIAC  by  Rea 
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Question  14: 


What  number  of  times  per  year  would  you 
probably  request  services  from  CSERIAC? 
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TABLE  A-4.11.  Respondents*  Estimates  of  Number  of  CSERIAC  Requests  Per  Year. 
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Question  6:  Please  check  your  THREE  most  important 
sources  of  CSE  information. 


TABLE  A-4.12.  Respondents'  Current  Sources  of  CSE  Information. 


PERCENTAGE  <%)  RESPONSES 


100 


N 

N 

P 

D 

N 

I 

w 

o 

o 

o 

e 

o 

n 

h 

t 

n 

o 

1 

t 

c 

e 

r 

a 

o 

r 

S 

e 

y 

C 

n 

e 

P 

X 

Q 

1 

V 

e 

i 

u 

t 

e 

e 

t 

c 

s 

a 

o 

a 

n 

o 

i 

t 

1 

r 

i 

f 

e 

i 

G 

e 

G 

i 

n 

t 

e 

n 

e 

c 

t 

y 

t 

t 

t 

F 

o 

r 

m 


Figure  A-4.13, 


Most  important  problems  encountered  by 
respondents  in  obtaining  CSE  information. 
(Percentages  based  on  combined  ranks  of 
"1"  and  "2"  only.) 


Question  7:  Which  of  these  problems  do  you  currently 

encounter  with  respect  to  CSE  information? 
Rate  each  chosen  item  from  1  (most  important 
or  frequent)  to  4  (least  important  or  least 
frequent) . 
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Figure  A- 4. 14 


Respondents'  preferences  of  products/ 
services  to  meet  their  CSE  information 
needs.  (Percentages  based  on  combined 
ranks  of  "1"  and  "2"  only.) 


Question  8: 


Which  of  these  products  or  services  do  you 
require  to  satisfy  your  CSE  information 
needs?  Rate  each  chosen  item  from  1  (most 
important  or  frequent)  to  4  (least  important 
or  least  frequent) . 
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Percentages  based  or  combined  ranks  of  "1"  and  "2”  only 
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Figure  A-4.15.  Respondents'  opinions  of  most  useful 

forms  of  CSE  information.  (Percentages 
based  on  combined  ranks  of  Hl"  and  "2" 
only. ) 
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Question  5i  Please  check  all  the  listed  CSE  topics 
that  are  important  in  your  work. 
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Question  5:  Please  check  all  the  listed  CSE  topics 
that  are  important  in  your  work . 
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TABLE  A-4.17.  Hunan  Performance  Topics  Relevant  to  Respondents'  Stork  Activity. 
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Figure  A-4.18. 


Methodological  topics  relevant  to 
respondents'  work  activity. 


Question  5:  Please  check  all  the  listed  CSE  topics 
that  are  important  in  your  work. 


A-47 


\nm  i_r» 


OOhh>  OSC'ij 


TABLE  A-4.18.  Methodological  Topics  Relevant  to  Respondents'  Work  Activity r 


,6 

i 

t 

v»  no  f*  wo  ft  r-  ft  \o  l 

<  N 

i 

•****••  #| 

i 

c>  tft  r*>  tn  m  tn  co  t 

is 

i 

r'r'tAw  wtom  i 
l 

i 

t 

i 

t 

as  i 

1 

w<hr>oocon\p  i 

! 

VOC'  W^NtMOO  I 

55 

i 

ta  vo  in  m  in  m  tn  «  i 

1 

I 

f  &  i 

i 

i 

Q  M  4 

i 

tn  Mn  o  ot  r-t  >H  io  i 

C  2 

i 

Q  W  1 

in^'rnnhN^H  I 

i  a 

§1 

• 

n-MO'otowmin  t 

i 

i 

t 

l 

i 

ss  n, 

a  « 

i 

t 

f'-  r't  rr)  r"  »r  o  rv  >-  i 

o  w 
S  « 

i 

i 

'Jtftrtmn.'in  i 

i  s 

Z  S3 

o  z 
z 

i 

i 

i 

i 

1 

l 

1 

1 

Eh 

i 

f"*  M*t  in  to  m  ie  cd  i 

i 

*••••#••  j 

D  W 

4 

N  O  ffll*t  00  f.  O  H  1 

88 

1 

1 

oor^vor-'tnvovom  t 

w 

o« 

1 

1 

» 

i 

« 

totoomtooDHOt  i 

w 

1 

o  r~  co  *r  t©  in  cm  j 

o  ac 

1 

MHHiiHHHH  | 

I 

1 

| 

z 

1 

1 

1 

1 

o 

E 

0) 


01 

<0 

Q) 


O 

a 

<o 


«  c 
•H  o 
W  -H 
>tp 
wh  m 
•H  tfl  3 
O  W  C  — 1 

>i<  td 

r-t  > 

-a  <o  'O  w 

sss- 

O  ft 
MH  .*  .*  p 

u  v)  u  </i 
ai  «  o  a) 

Q«  Eh  3:  gn 


(/> 
Cn-H 
C  ui 
<H  >i  Q! 


M 

Q1  td 

•H 
Cr 
c 

W 

•H 

«  P 

E  w 

35  "H 

P  P 
V)  IQ 
>ip 


O 
C 
10 
E 
M 
O 
id  p 

o  u 


w 

•H 

;<i 

>i 

ft 

id 

C 

c 

V 

c 

o 

•H 

P 

Id 

o 

o 


c 

o 

H 

P 

o 

c 

3 


03  ui  a:  cn 


a 

■•A 

P 

C 

to 

p 

M 

O 

I 


9 

K 

9 

P 

« 

J3 

P 


9 

§ 

'3 


m 

o 

•H 

Cb 

o 

p 

w 

CO 

u 

a> 


r-t 

to 

a: 

o 

ai  . 
x:  * 
o  n 


0) 

03 

to 

0) 

*H 

Qt 


0 

3t 

u 

'J 

o 

>1 


in 

z 

o 

H 

Eh 

CO 

w 

D 

a 


A-48 


yyxi 


PERCENTAGE  (%) 


TABLE  A-4. 19.  Design  &  Engineering  Topics  Relevant  to 

Respondents'  Work  Activity. 
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Figure  A-4.20. 


Special  topics  relevant  to  respondents 
work  activity. 


Question  5:  Please  check  all  the  listed  CSE  topics 
that  are  important  in  your  work. 


TABLE  A-4.20.  Special  Topics  Relevant  to  Respondents'  Work  Activity. 
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INFORMATION  ANALYSIS  CENTERS  (IACS) 


Government  Hiuftrit  telantiit*  and  engineers,  and 
government  oontractora  extensively  uaa  the  Dafanaa  Technical 
Intonation  Contar  (OTIC).  Tha  DTTC  storaa  and,  on  request, 
provides  copies  of  documents  produced  by  the  Department  of 
Defense  (DoD).  OTIC  also  supplies  specialised  bibliographies 
based  on  key-word  searches  of  its  data  base. 

Although  these  are  valuable  services,  the  users  of  DTIC  must 
decide  what  documents  and  bibliographic  search  strategies  will 
yield  the  Information  that  they  need.  A  common  problem  is  the 
uncertainty  that  the  documents  relevant  to  a  particular  need  have 
been  found.  Moreover,  users  are  burdened  with  the  analytical  and 
interpretive  taska  of  extracting,  evaluating  and  integrating  the 
information  contained  in  the  source  documents.  These  tasks  are 
especially  difficult  for  documents  written  by  scientists  or 
engineers  whose  specialties  are  outside  the  user's  domain  of 
expertise. 

To  alleviate  theae  burdens,  the  DoD  has  instituted  an 
information  service  that  goes  well  beyond  the  basic  document 
retrieval  functions  provided  by  DTIC.  This  service  is  provided 
through  a  network  of  organisations  called  Information  Analysis 
Centers  (IACa).  Their  function  is  to  perform  the  time  consuming 
and  difficult  search,  analysis,  and  interpretation  tasks  that  are 
usually  the  responsibility  of  the  information  user.  The  primary 
purpose  of  an  IAC  is  to  supply  its  users  with  up-to-date 
information,  in  the  desired  fora,  as  rapidly  as  possible. 

An  IAC  collects,  stores,  reviews,  analyses,  and  summarises 
scientific,  technical,  and  engineering  information  and  data 
within  its  specialised  area.  The  collection  of  source  material, 
accessible  by  computer,  is  continually  updated  to  incorporate  the 
most  current  international  research  information  within  tha 
specialised  area,  and  analysed  and  organised  in  a  fora  to  meet 
the  expressed  or  anticipated  heeds  of  the  IAC  users. 

There  are  many  types  of  reports  produced  by  an  IAC  including 
bibliographies,  abstracts,  state-of-the-art  reviews,  special 
analysis  and  evaluation  reports,  and  current  awareness 
newsletters.  Except  for  its  own  products,  an  IAC  does  not  copy 
and  disseminate  source  documents;  these  functions  are  the 
responsibility  of  the  DTIC. 

IACs  are  staffed  by  professional  analysts,  expert  in  their 
subject  areas.  In  addition,  IACs  use  consultants  for  special 
projects  and  provide  referral  services  to  users  who  may  wish  to 
contact  an  organization  or  individual  with  particular  expertise. 
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CCMinlcttion  with  an  ZAC  usually  starts  with  a  phone  call 
froai  tha  uaar  to  an  analyst  who  understands  tha  user's  raquaat. 
•abaafiant  ooaasunieatlona  stay  ba  by  phona.  conventional  nail  or 
alaotronio  stall.  Olract  aocaaa  to  tha  IAC  data  baa a  via 
talaaoasaunioaticna  la  alao  poaaibla.  Thara  ara  nominal  faaa. 
established  on  a  coat  racovary  baaia.  for  ZAC  aarvicaa  although 
ataa  ara  fraa. 


Currantly.  thore  ara  twenty-one  lACs.  Tha  first  was 
astabliahad  over  thirty  years  ago.  Soma  of  tha  existing  XACa  and 
a  phone  nustLter  for  a  point  of  contact  ara  listed  below. 

Coastal  Engineers  Information  Analysis  Center  (CEZAC) 

(202)  325*7012 

Chemical  propulsion  Information  Agency  (CPXA) 

(301)  953-7100,  Ext.  3152,  7879,  or  7803 

Concrete  Technology  information  Analysis  Canter  (CTXAC) 

(801)  634-3264/3289 

Data  and  Analysis  Canter  for  Software  (DACS) 

(313)  330-3393  (Autovon  587-3395) 

DoD  Nuclear  Xnfonaation  Analysis  Canter  (DASXAC) 


luelear  Xnfonaation  Analysis  Cant 
(80S)  963-0331,  Ext.  293,  nr  200 


Guidanoe  and  Control  Information  Analysis  Center  (UACIAC) 

(312)  567-4319/4544 

Infrared  Information  Analysis  Center  (IRIK) 

(313)  994-1200,  Ext.  214 

Metals  and  Ceramics  Information  Center  (MCIC) 

(614)  424-6372/6376 

Reliability  Analysis  Center  (RAC) 

(315)  330-4151  (Autovon  587-4151) 

Survivability/Vulnerability  Information  Analysis  Center  (SURVIAC) 
(513)  255-4840 

Shock  and  Vibration  Information  Center  (SVIC) 

(202)  767-2221 

Tactical  Technology  Center  (TACTEC) 

(614)  424-7010 


More  information  on  existing  ZACs  can  be  obtained  from  the 
pamphlet  "Information  Analysis  Centers  Profiles"  available  free 
from  the  Defense  Technical  Information  Center,  Cameron  Station, 
Alexandria,  VA  22314. 
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QUESTIONNAIRE 

PLEASE  COMPLETE  AND  RETURN  WITHIN  THREE  WEEKS 


Th*  term  Cr*w  Systems  Ergonomics  (CSB)  und  in  this  questionnaire 
Mans  the  behavioral,  biomedical,  and  human  factors  engineering 
inforaiation  and  data  that  affect,  or  result  from,  th*  design, 
dev*lo(asent  and  operation  of  circraft  and  spacecraft. 

Pleas*  leave  blank  any  question  that  does  not  apply  to  you  or  for 
which  you  have  no  opinion.  Space  for  comments  is  provided  on  th*  last 
page  if  you  wish  to  qualify  or  expand  on  any  of  your  responses. 


1.  Is  there  a  need  for  a  center  to  provide  crew  systems  ergonomics 
information  analysis  services? 

_ Yes  _ No  _ Don't  know 


2.  If  YES,  should  the  center  be  a  DoD  Information  Analysis  Center  (IAC)? 


Yea  _ No _ Don  t  know 


If  your  answer  is  NO  to  either  or  both  questions  1  and  2,  please  give 
your  reasons. 


3.  How  frequently  do  you  use  CSE  Information  in  your  work? 
Please  check  only  one. 


Never  _ Infrequently _ Frequently  _ Very  Frequently 


4.  Do  you  ever  generate  CSE  information?  _ Yes  No 
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5.  Please  check  all  the  Ci.fi  topics  below  that  are  important  in  your 
work. 


BIOMEDICAL 

_ G  loading 

_ Stress  and  Fatigue 

_ Motion  and  Vibration 

_ Hypoxia  and  Gas  Mixture 

_ Thermal  Effects 

_ Hyperbaria 

_ Chen.,  Bio.,  and  Rad.  Effects 

_ Anthropometry  or  Biomechanics 

METHODOLOGIES 

_ Task  Analysis 

Workload  Analysis 

_ Systems  Engineering 

Function  Allocation/Analynis 
DESIGN  AND  ENGINEERING 

_ Displays 

_ Controls 

_ Multifunction  DsplyS-Cntrls. 

_ Communications 

_ Voice  Technology 

_ Life  Support 

SPECIAL  TOPICS 
_ Simulators 

_ _ Multi -Crewmember  Interaction 

_ Safety/Accident  Prevention 


HOMAN  PERFORMANCE 

_ Sensory  Factors 

_ Perception 

_ Information  Processing 

_ Cognitive  Processes 

_ Individual  Differences 

_ Learning 

_ Motor  Control 

_ Communication 

_ Performance  Measurement 

_ Test  and  Evaluation 

_ Statistical  Analysis 

_ Human  Performance  Modeling 

_ Ejection/Survival  Systems 

_ Personal  Equipment 

_ Human-System  Integration 

_ Crew  Station  Layout 

_ Vehicle  Handling  Qualities 

_ Guidance  and  Contro' 

_ Automation 

_ Artificial  Intelligence 

_ Standards 


OTHER 
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6.  Please  check  your  THRBB  moat  important  sources  of  CSE  information. 
Do  not  cheok  more  than  three . 

_ Receive  technical  Reports  Directly  from  Originating  Source 

Defense  Technical  Information  Center  (DTIC) 

_ National  Technical  Information  Service  (NTIS) 


.Textbooks 

.On-line  Data  Base(s) 
.Conference  Presentations 
_Staff  Specialist  or  Colleague 
Local  Library 
Other 


_Handbooks 

Journals 

Seminars/  Workshops 
Consultant 


7.  Which  of  the  following  problems  do  you  currently  encounter  with 
respect  to  CSE  information?  Please  rate  each  chosen  item  from  1 
(most  important  or  frequent)  to  4  (least  important  or  least 
frequent).  Rate  as  many  as  are  applicable.  Rating  numbers  may  be 
used  more  than  once. 

1 _ 2 _ 3 _ 4 

Most  important  Least  Important 

or  frequent  or  least  frequent 


Difficult  to  maintain  awareness  of  technical  or  analytical 
information  that  is  available. 

Needed  information  does  not  exist. 

Inconvenient  form  of  information. 

Information  not  clearly  and  succinctly  presented. 

Poor  quality  of  information,  i.e.,  unreliable,  dated  or  not 
quantitative. 

Information  is  not  specific  to  my  particular  needs. 

Delay  time  to  obtain  needed  information. 

Don't  know  where  to  go  to  get  needed  information. 

Other 
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8.  Which  of  the  following  products  or  services  do  you  require  to 
satisfy  your  C8B  information  needs?  Please  rate  each  chosen  item 
from  1  (most  important  or  frequent)  to  4  (least  important  or 
least  frequent).  Rate  as  many  as  are  applicable.  Rating  numbers  may 
be  used  more  than  once. 

1 _ 2 _ 3 _ 4 

Most  important  Least  important 

or  freauent  ~  or  least  frequent 


State-of-the-Art  Reviews 
Current  Awareness  Newsletter 
Current  Awarenesu  Bibliographies 
Handbooks 
Technology  Briefs 
Dedicated  CSE  Journal 
Computer-based  Model  Data 
Other _ 


Quick  Response  to  Inquiry 
Conferences  or  Symposia 
Workshops 

Standards  or  Practices 
Training  Materials 
Current  Projects  Status 
Consultant  Referral 


9.  Kith  regard  to  your  most  frequent  needs,  how  useful  are  the 

following  forms  for  CSB  information?  Please  rate  each  chosen  item 
from  1  (most  useful)  to  4  (least  useful).  Rating  numbers  may  be 
used  more  than  once. 

1 _ 2 _ 3 _ 4 

Most  useful  Least  useful 


Tabular  and  Graphic  data 
Topical  Reviews 
Bibliographies 

Guidelines  with  Justifications  and  References 
Full  Report  of  a  Study  or  Project 
Study  or  Project  Summary 

Special  Analysis  Report  Specific  to  Current  Need 
.Data  Generated  from  a  Computer-based  Model 
Other 
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10.  Which  of  the  following  activities  best  describe  your  regular  work? 
If  more  than  one  applies  please  use  1  for  primary  and  2  for 
secondary.  Do  not  mark  more  than  two  activities. 

_ Management  _ .Design 

_ Administration  _ Test  and  Evaluation 

_ Research  and  Development  _ Education 

_ Other _ _ _  - _ 


♦ 


11.  Which  of  the  following  discipline  areas  best  describe  your 

formal  educational  background?  If  more  than  one  applies,  please  use 
1  for  primary  and  2  for  secondary.  Do  not  mark  more  than  two  areas. 


Engineering 

Mathematics 

Computer  Science 

Management 

Operations  Research 

.Biology 

Social  Science 


Behavioral  Science 
Physical  Science 
Information/Library  Science 
Medicine 

Human  Factors/Ergonomics 
.Physiology 

Other _ _ 


12.  Please  indicate  your  current  employment.  Check  only  one. 

Active  Duty  Military;  _ Air  Force  _ Army  _ Navy  _ Marines 

Federal  Civil  Service;  _ DoD  _ Non-Dod  _ Coast  Guard 

Private  sector:  _ Industry  _ Academia  _ Self-Employed 

Retired: 


13.  Fees  would  be  charged  to  cover  the  costs  of  most  services  provided 
by  a  crew  systems  ergonomics  information  analysis  center  (CSERIAC). 

To  what  degree  would  this  affect  your  use  of  CSERIAC?  Please  check 
only  one. 

_ I  would  pay  a  reasonable  fee  for  the  CSERIAC  services  I  need. 

_ .1  would  only  use  the  CSERIAC  services  that  are  free. 

_ I  probably  would  not  use  CSERIAC  services  even  if  they  were  free. 
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14 .  What  number  of  times  per  year  would  you  probably  request  services 
from  C8ERXAC? 

Please  write  in  number.  _ 


Comments  (You  may  consider,  for  example,  other  options  to  answer  a 
question,  how  you  would  use  a  CSERIAC,  preferred  access 
method.)  Please  use  additional  sheets  if  you  wish. 


NAME  AMP  ADDRESS  (optional) 

If  you  provide  your  name  and  address  in  the  upper,  left  corner 
of  the  return  envelope,  they  will  be  used  solely  to  send  you  information 
about  CSERIAC  if  and  when  it  becomes  operational.  The  questionnaires 
will  be  separated  from  the  envelopes  on  receipt  to  maintain  anonymity  of 
all  respondents. 


Thank  you  for  participating  in  this  survey.  Please  return  ONLY  THE 
QUESTIONNAIRE  AND  ANY  ADDITIONAL  COMMENT  SHEETS  in  the  business  reply 
envelope  provided.  No  postage  is  necessary.  Monterey  Technologies, 

Inc.  is  under  contract  to  the  Air  Force  to  compile  and  summarize  the 
questionnaire  data. 
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